[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:16:43 dist-test-slave-39l8 krb5kdc[1538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:16:43 dist-test-slave-39l8 krb5kdc[1538](info): set up 2 sockets
Aug 07 02:16:43 dist-test-slave-39l8 krb5kdc[1538](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 02:16:44.854151 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:16:44 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:16:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:16:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:16:44.984833 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46343
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:46699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:46343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:45.152673 1557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:45.153049 1557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:45.153170 1557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:45.158017 1557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:16:45.158111 1557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:45.158155 1557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:45.158218 1557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:16:45.158264 1557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:16:45.164911 1557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:46699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:46343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:45.166688 1557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:45.168255 1557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:45.180490 1563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:45.181375 1562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:45.181387 1566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:45.182184 1557 server_base.cc:1034] running on GCE node
I20260807 02:16:45.183161 1557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:45.184953 1557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:45.186180 1557 hybrid_clock.cc:648] HybridClock initialized: now 1786069005186141 us; error 74 us; skew 500 ppm
Aug 07 02:16:45 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:45.189466 1557 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:16:45.190783 1557 webserver.cc:460] Webserver started at http://127.1.126.254:39339/ using document root <none> and password file <none>
I20260807 02:16:45.191695 1557 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:45.191803 1557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:45.192247 1557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:45.195494 1557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "6198fc658cf14feea6a254f66e1c6817"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "b277edb5dd83601621ac994d5de2ea28"
server_key_iv: "9c8c661e6d0c2dfd95245160789707e7"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.196390 1557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "6198fc658cf14feea6a254f66e1c6817"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "b277edb5dd83601621ac994d5de2ea28"
server_key_iv: "9c8c661e6d0c2dfd95245160789707e7"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.202112 1557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 02:16:45.205828 1575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.207688 1557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 02:16:45.207944 1557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "6198fc658cf14feea6a254f66e1c6817"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "b277edb5dd83601621ac994d5de2ea28"
server_key_iv: "9c8c661e6d0c2dfd95245160789707e7"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.208123 1557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:45.229571 1557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:45.233614 1557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:45.233832 1557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:45.247315 1557 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:46343
I20260807 02:16:45.247458 1649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:46343 every 8 connection(s)
I20260807 02:16:45.248843 1557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:16:45.253906 1650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:45.254426 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 1557
I20260807 02:16:45.254611 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:16:45.256064 1531 external_mini_cluster.cc:1428] Setting key 985dc79ff7a94a3c0b86b36777c8c002
I20260807 02:16:45.264158 1650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817: Bootstrap starting.
I20260807 02:16:45.268729 1650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:45.270236 1650 log.cc:824] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:45.273347 1650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817: No bootstrap required, opened a new log
I20260807 02:16:45.279740 1650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6198fc658cf14feea6a254f66e1c6817" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46343 } }
I20260807 02:16:45.280198 1650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:45.280344 1650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6198fc658cf14feea6a254f66e1c6817, State: Initialized, Role: FOLLOWER
Aug 07 02:16:45 dist-test-slave-39l8 krb5kdc[1538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:45.281078 1650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6198fc658cf14feea6a254f66e1c6817" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46343 } }
I20260807 02:16:45.281311 1650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:16:45.281452 1650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:16:45.281594 1650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:45.282617 1650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6198fc658cf14feea6a254f66e1c6817" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46343 } }
I20260807 02:16:45.283219 1650 leader_election.cc:302] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6198fc658cf14feea6a254f66e1c6817; no voters:
I20260807 02:16:45.283645 1650 leader_election.cc:288] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:16:45.283777 1656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:45.283984 1656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [term 1 LEADER]: Becoming Leader. State: Replica: 6198fc658cf14feea6a254f66e1c6817, State: Running, Role: LEADER
I20260807 02:16:45.284401 1656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6198fc658cf14feea6a254f66e1c6817" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46343 } }
I20260807 02:16:45.285676 1650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:16:45.288440 1657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6198fc658cf14feea6a254f66e1c6817" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6198fc658cf14feea6a254f66e1c6817" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46343 } } }
I20260807 02:16:45.288617 1657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:45.289983 1659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6198fc658cf14feea6a254f66e1c6817. Latest consensus state: current_term: 1 leader_uuid: "6198fc658cf14feea6a254f66e1c6817" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6198fc658cf14feea6a254f66e1c6817" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46343 } } }
I20260807 02:16:45.290150 1654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:45.262811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43608 (local address 127.1.126.254:46343)
0807 02:16:45.263232 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:45.263247 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:45.263320 (+ 73us) server_negotiation.cc:407] Connection header received
0807 02:16:45.267769 (+ 4449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:45.267784 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:45.268215 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:45.268492 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:45.272210 (+ 3718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.273580 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.275683 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.276235 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.276400 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:45.282132 (+ 5732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:45.282172 (+ 40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:45.282185 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:45.282217 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:45.284388 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:45.285038 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:45.285042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:45.285046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:45.285161 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:45.285538 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:45.285541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:45.285543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:45.286120 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:45.286326 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:45.288786 (+ 2460us) server_negotiation.cc:299] Negotiation successful
0807 02:16:45.289091 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":128,"threads_started":1}
I20260807 02:16:45.290182 1659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817 [sys.catalog]: This master's current role is: LEADER
W20260807 02:16:45.294644 1682 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:16:45.294850 1682 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:16:45.294963 1681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:16:45.295885 1681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:16:45.302803 1681 catalog_manager.cc:1347] Generated new cluster ID: f6760ecc27934e9984eb876c05ad80e4
I20260807 02:16:45.302877 1681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:16:45.317271 1681 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:16:45.318301 1681 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:16:45.335666 1681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6198fc658cf14feea6a254f66e1c6817: Generated new TSK 0
I20260807 02:16:45.336663 1681 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:16:45.371809 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46343
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:46699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:45.520592 1687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:45.520846 1687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:45.520889 1687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:45.524943 1687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:45.525005 1687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:45.525090 1687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:16:45.530372 1687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:46699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46343
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:45.531551 1687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:45.532639 1687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:45.542963 1701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:45.542963 1698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:45.543073 1687 server_base.cc:1034] running on GCE node
W20260807 02:16:45.542986 1696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:45.543660 1687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:45.544296 1687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:45.545528 1687 hybrid_clock.cc:648] HybridClock initialized: now 1786069005545508 us; error 30 us; skew 500 ppm
Aug 07 02:16:45 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:45.548506 1687 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:16:45.549552 1687 webserver.cc:460] Webserver started at http://127.1.126.193:40893/ using document root <none> and password file <none>
I20260807 02:16:45.550191 1687 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:45.550256 1687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:45.550420 1687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:45.552732 1687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "fdee66a4e5494be6a6937bca24e92002"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "ff377b48cfd655cf616419814b2305b0"
server_key_iv: "402d169136b9d61f3f5197a98d12f688"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.553282 1687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "fdee66a4e5494be6a6937bca24e92002"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "ff377b48cfd655cf616419814b2305b0"
server_key_iv: "402d169136b9d61f3f5197a98d12f688"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.556999 1687 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 02:16:45.559448 1709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.560638 1687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:16:45.560750 1687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "fdee66a4e5494be6a6937bca24e92002"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "ff377b48cfd655cf616419814b2305b0"
server_key_iv: "402d169136b9d61f3f5197a98d12f688"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.560837 1687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:45.575242 1687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:45.578630 1687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:45.578855 1687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:45.579500 1687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:16:45.580605 1687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:45.580657 1687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.580701 1687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:45.580724 1687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.590571 1687 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:34965
I20260807 02:16:45.590601 1857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:34965 every 8 connection(s)
I20260807 02:16:45.591563 1687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:16:45.600680 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 1687
I20260807 02:16:45.600795 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:16:45.601094 1531 external_mini_cluster.cc:1428] Setting key d51d5162e5fc7fe54b4e33ab61092f9a
Aug 07 02:16:45 dist-test-slave-39l8 krb5kdc[1538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:45.606534 1654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:45.593713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:47231 (local address 127.1.126.254:46343)
0807 02:16:45.593869 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:45.593874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:45.594780 (+ 906us) server_negotiation.cc:407] Connection header received
0807 02:16:45.596330 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:45.596332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:45.596380 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:45.596456 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:45.597593 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.598117 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.599285 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.599517 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.599597 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:45.602546 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:45.602550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:45.602552 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:45.602579 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:45.604422 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:45.604960 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:45.604964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:45.604965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:45.605050 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:45.605442 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:45.605445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:45.605447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:45.605630 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:45.605737 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:45.606240 (+ 503us) server_negotiation.cc:299] Negotiation successful
0807 02:16:45.606372 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 02:16:45.607388 1862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:45.594085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46343 (local address 127.1.126.193:47231)
0807 02:16:45.594575 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:45.594631 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:45.596126 (+ 1495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:45.596619 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:45.596626 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:45.596975 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:45.597466 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:45.597480 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.598226 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.598228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:45.599183 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:45.599193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.599647 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.599650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:45.599785 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:45.600441 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:45.600467 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:45.602311 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:45.604555 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:45.604560 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:45.604572 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:45.604830 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:45.605186 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:45.605188 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:45.605190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:45.605331 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:45.605739 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:45.605749 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:45.605993 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 02:16:45.606193 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 02:16:45.606529 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":114,"threads_started":1}
I20260807 02:16:45.608789 1858 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46343
I20260807 02:16:45.609110 1858 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:45.609797 1858 heartbeater.cc:511] Master 127.1.126.254:46343 requested a full tablet report, sending...
I20260807 02:16:45.612432 1599 ts_manager.cc:194] Registered new tserver with Master: fdee66a4e5494be6a6937bca24e92002 (127.1.126.193:34965)
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:16:45.614193 1599 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:47231
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:16:45.629093 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46343
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:46699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:45.747018 1866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:45.747278 1866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:45.747323 1866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:45.752568 1866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:45.752626 1866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:45.752710 1866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:16:45.758076 1866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:46699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46343
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:45.759223 1866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:45.760267 1866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:45.769984 1874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:45.769975 1875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:45.769975 1877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:45.770303 1866 server_base.cc:1034] running on GCE node
I20260807 02:16:45.770787 1866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:45.771404 1866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:45.772578 1866 hybrid_clock.cc:648] HybridClock initialized: now 1786069005772549 us; error 46 us; skew 500 ppm
Aug 07 02:16:45 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:45.775484 1866 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:16:45.776346 1866 webserver.cc:460] Webserver started at http://127.1.126.194:32803/ using document root <none> and password file <none>
I20260807 02:16:45.776965 1866 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:45.777063 1866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:45.777256 1866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:45.779311 1866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "4613776c8d704ce59770d71af5d5e72a"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "086405ea82f556bba12ddd7cbc0c0cec"
server_key_iv: "3767ba88f6596ecfedcfb3022da7b2a1"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.779814 1866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "4613776c8d704ce59770d71af5d5e72a"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "086405ea82f556bba12ddd7cbc0c0cec"
server_key_iv: "3767ba88f6596ecfedcfb3022da7b2a1"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.783550 1866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:16:45.786054 1888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.787478 1866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 02:16:45.787595 1866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "4613776c8d704ce59770d71af5d5e72a"
format_stamp: "Formatted at 2026-08-07 02:16:45 on dist-test-slave-39l8"
server_key: "086405ea82f556bba12ddd7cbc0c0cec"
server_key_iv: "3767ba88f6596ecfedcfb3022da7b2a1"
server_key_version: "encryptionkey@0"
I20260807 02:16:45.787710 1866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:45.813933 1866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:45.817339 1866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:45.817548 1866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:45.818186 1866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:16:45.819120 1866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:45.819180 1866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.819270 1866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:45.819305 1866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:45.830082 1866 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:40201
I20260807 02:16:45.830090 2054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:40201 every 8 connection(s)
I20260807 02:16:45.831105 1866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:16:45.835650 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 1866
I20260807 02:16:45.835789 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:16:45.836125 1531 external_mini_cluster.cc:1428] Setting key 224e2fc0a8df7c918b07f756962626c6
Aug 07 02:16:45 dist-test-slave-39l8 krb5kdc[1538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:45.847455 1654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:45.833087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:55675 (local address 127.1.126.254:46343)
0807 02:16:45.833229 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:45.833239 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:45.834064 (+ 825us) server_negotiation.cc:407] Connection header received
0807 02:16:45.835781 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:45.835789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:45.835869 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:45.835984 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:45.837434 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.838128 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.839955 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.840382 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.840510 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:45.843420 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:45.843428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:45.843431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:45.843463 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:45.845072 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:45.845738 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:45.845740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:45.845741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:45.845813 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:45.846238 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:45.846240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:45.846241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:45.846409 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:45.846483 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:45.847232 (+ 749us) server_negotiation.cc:299] Negotiation successful
0807 02:16:45.847330 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:16:45.848810 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:45.833408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46343 (local address 127.1.126.194:55675)
0807 02:16:45.833873 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:45.833916 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:45.835416 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:45.836183 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:45.836194 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:45.836675 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:45.837252 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:45.837266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.838268 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.838274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:45.839809 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:45.839825 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:45.840550 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:45.840554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:45.840697 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:45.841348 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:45.841365 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:45.843238 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:45.845216 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:45.845223 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:45.845241 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:45.845624 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:45.845909 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:45.845913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:45.845916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:45.846134 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:45.846517 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:45.846523 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:45.846915 (+ 392us) client_negotiation.cc:769] Sending connection context
0807 02:16:45.847161 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 02:16:45.847687 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":120,"threads_started":1}
I20260807 02:16:45.850183 2055 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46343
I20260807 02:16:45.850436 2055 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
I20260807 02:16:45.851082 2055 heartbeater.cc:511] Master 127.1.126.254:46343 requested a full tablet report, sending...
I20260807 02:16:45.852246 1599 ts_manager.cc:194] Registered new tserver with Master: 4613776c8d704ce59770d71af5d5e72a (127.1.126.194:40201)
I20260807 02:16:45.853049 1599 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:55675
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:16:45.866987 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46343
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:46699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:45.987242 2060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:45.987537 2060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:45.987634 2060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:45.991909 2060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:45.991993 2060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:45.992102 2060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:16:45.997633 2060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:46699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46343
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:45.998879 2060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:45.999969 2060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:46.010076 2067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:46.010063 2070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:46.010046 2066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:46.010154 2060 server_base.cc:1034] running on GCE node
I20260807 02:16:46.010766 2060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:46.011396 2060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:46.012573 2060 hybrid_clock.cc:648] HybridClock initialized: now 1786069006012537 us; error 46 us; skew 500 ppm
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069006, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:46.015976 2060 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:16:46.017140 2060 webserver.cc:460] Webserver started at http://127.1.126.195:44351/ using document root <none> and password file <none>
I20260807 02:16:46.017886 2060 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:46.017982 2060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:46.018282 2060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:46.021044 2060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "8d3fee15bbd64f2d9a1cd154e7f0748a"
format_stamp: "Formatted at 2026-08-07 02:16:46 on dist-test-slave-39l8"
server_key: "e151eb6d623884edaab7c1a5309f593c"
server_key_iv: "69288f4692d1dc603589b0b5dfbb5387"
server_key_version: "encryptionkey@0"
I20260807 02:16:46.021804 2060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "8d3fee15bbd64f2d9a1cd154e7f0748a"
format_stamp: "Formatted at 2026-08-07 02:16:46 on dist-test-slave-39l8"
server_key: "e151eb6d623884edaab7c1a5309f593c"
server_key_iv: "69288f4692d1dc603589b0b5dfbb5387"
server_key_version: "encryptionkey@0"
I20260807 02:16:46.025797 2060 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 02:16:46.028287 2081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:46.029513 2060 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:16:46.029665 2060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "8d3fee15bbd64f2d9a1cd154e7f0748a"
format_stamp: "Formatted at 2026-08-07 02:16:46 on dist-test-slave-39l8"
server_key: "e151eb6d623884edaab7c1a5309f593c"
server_key_iv: "69288f4692d1dc603589b0b5dfbb5387"
server_key_version: "encryptionkey@0"
I20260807 02:16:46.029778 2060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:46.067444 2060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:46.070509 2060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:46.070763 2060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:46.071406 2060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:16:46.072364 2060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:46.072438 2060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:46.072507 2060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:46.072553 2060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:46.083240 2060 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:36173
I20260807 02:16:46.083279 2251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:36173 every 8 connection(s)
I20260807 02:16:46.084589 2060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:16:46.094580 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 2060
I20260807 02:16:46.094759 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:16:46.095106 1531 external_mini_cluster.cc:1428] Setting key cb7bc1474812aec7809deb8f1ab57316
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[1538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069006, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:46.100518 1654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:46.086856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:39171 (local address 127.1.126.254:46343)
0807 02:16:46.087044 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:46.087048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:46.088021 (+ 973us) server_negotiation.cc:407] Connection header received
0807 02:16:46.089657 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:46.089661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:46.089726 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:46.089808 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:46.091134 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.091672 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.093048 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.093327 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.093410 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:46.096274 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:46.096277 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:46.096280 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:46.096311 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:46.098050 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:46.098593 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:46.098596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:46.098597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:46.098682 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:46.099059 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:46.099061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:46.099062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:46.099313 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:46.099420 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:46.100198 (+ 778us) server_negotiation.cc:299] Negotiation successful
0807 02:16:46.100343 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 02:16:46.101392 2254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:46.087351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46343 (local address 127.1.126.195:39171)
0807 02:16:46.087828 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:46.087908 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:46.089405 (+ 1497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:46.090001 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:46.090007 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:46.090380 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:46.090939 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:46.090955 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.091802 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.091805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:46.092925 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:46.092935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.093461 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.093463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:46.093612 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:46.094161 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:46.094178 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:46.096075 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:46.098167 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:46.098174 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:46.098191 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:46.098486 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:46.098809 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:46.098812 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:46.098813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:46.098963 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:46.099428 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:46.099437 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:46.099838 (+ 401us) client_negotiation.cc:769] Sending connection context
0807 02:16:46.100091 (+ 253us) client_negotiation.cc:240] Negotiation successful
0807 02:16:46.100459 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":129,"threads_started":1}
I20260807 02:16:46.102581 2252 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46343
I20260807 02:16:46.102857 2252 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:46.103400 2252 heartbeater.cc:511] Master 127.1.126.254:46343 requested a full tablet report, sending...
I20260807 02:16:46.104434 1599 ts_manager.cc:194] Registered new tserver with Master: 8d3fee15bbd64f2d9a1cd154e7f0748a (127.1.126.195:36173)
I20260807 02:16:46.105016 1599 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:39171
I20260807 02:16:46.110023 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[1538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:16:46.139904 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:46.130055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41064 (local address 127.1.126.193:34965)
0807 02:16:46.130379 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:46.130386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:46.130415 (+ 29us) server_negotiation.cc:407] Connection header received
0807 02:16:46.130468 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:46.130473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:46.130680 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:46.130858 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:46.131498 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.132256 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.133107 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.133518 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.133646 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:46.136095 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:46.136106 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:46.136273 (+ 167us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:46.136306 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:46.137987 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:46.138466 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:46.138472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:46.138473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:46.138563 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:46.138887 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:46.138891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:46.138892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:46.139155 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:46.139311 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:46.139512 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 02:16:46.139700 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":115,"threads_started":1}
W20260807 02:16:46.141007 1740 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41064
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[1538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[1538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:16:46.169948 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:46.161286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41070 (local address 127.1.126.193:34965)
0807 02:16:46.161483 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:46.161488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:46.161588 (+ 100us) server_negotiation.cc:407] Connection header received
0807 02:16:46.161760 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:46.161763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:46.161812 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:46.161898 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:46.162620 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.163238 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.164085 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:46.164324 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:46.164433 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:46.167007 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:46.167011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:46.167019 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:46.167042 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:46.168275 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:46.168704 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:46.168712 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:46.168713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:46.168788 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:46.169061 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:46.169065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:46.169067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:46.169259 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:46.169393 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:46.169641 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 02:16:46.169775 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 02:16:46.171310 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 1687
I20260807 02:16:46.182152 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 1866
I20260807 02:16:46.191741 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 2060
I20260807 02:16:46.202927 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 1557
2026-08-07T02:16:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2647 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[2275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[2275](info): set up 2 sockets
Aug 07 02:16:46 dist-test-slave-39l8 krb5kdc[2275](info): commencing operation
krb5kdc: starting...
W20260807 02:16:47.430279 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:16:47 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:16:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:16:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:16:47.557678 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:41789
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:41789
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:47.673448 2301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:47.673764 2301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:47.673842 2301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:47.677866 2301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:16:47.677960 2301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:47.677999 2301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:47.678049 2301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:16:47.678087 2301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:16:47.683527 2301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:41789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:41789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:47.684657 2301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:47.685729 2301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:47.694485 2309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:47.694479 2312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:47.694568 2301 server_base.cc:1034] running on GCE node
W20260807 02:16:47.694450 2310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:47.695382 2301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:47.696491 2301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:47.697674 2301 hybrid_clock.cc:648] HybridClock initialized: now 1786069007697639 us; error 47 us; skew 500 ppm
Aug 07 02:16:47 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:47.700578 2301 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:16:47.701495 2301 webserver.cc:460] Webserver started at http://127.1.126.254:46315/ using document root <none> and password file <none>
I20260807 02:16:47.702056 2301 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:47.702119 2301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:47.702303 2301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:47.704408 2301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "5a857c1872804276be55d1db24d062d0"
format_stamp: "Formatted at 2026-08-07 02:16:47 on dist-test-slave-39l8"
server_key: "8a51388fcef870c0bef3c384a4c4d21e"
server_key_iv: "8117eefaa225dacfd0e2e47636363903"
server_key_version: "encryptionkey@0"
I20260807 02:16:47.704936 2301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "5a857c1872804276be55d1db24d062d0"
format_stamp: "Formatted at 2026-08-07 02:16:47 on dist-test-slave-39l8"
server_key: "8a51388fcef870c0bef3c384a4c4d21e"
server_key_iv: "8117eefaa225dacfd0e2e47636363903"
server_key_version: "encryptionkey@0"
I20260807 02:16:47.708801 2301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260807 02:16:47.711339 2324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:47.712574 2301 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:16:47.712684 2301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "5a857c1872804276be55d1db24d062d0"
format_stamp: "Formatted at 2026-08-07 02:16:47 on dist-test-slave-39l8"
server_key: "8a51388fcef870c0bef3c384a4c4d21e"
server_key_iv: "8117eefaa225dacfd0e2e47636363903"
server_key_version: "encryptionkey@0"
I20260807 02:16:47.712778 2301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:47.729607 2301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:47.732739 2301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:47.732903 2301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:47.740259 2301 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:41789
I20260807 02:16:47.740305 2397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:41789 every 8 connection(s)
I20260807 02:16:47.741230 2301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:16:47.744115 2399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:47.744465 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 2301
I20260807 02:16:47.744578 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:16:47.744867 1531 external_mini_cluster.cc:1428] Setting key a07b12a5e4d25aea94d9e9ae8eeef834
I20260807 02:16:47.751367 2399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0: Bootstrap starting.
Aug 07 02:16:47 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:47.753885 2399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:47.754957 2399 log.cc:824] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:47.757717 2399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0: No bootstrap required, opened a new log
I20260807 02:16:47.760536 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:47.746326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33458 (local address 127.1.126.254:41789)
0807 02:16:47.746825 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:47.746841 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:47.746876 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:16:47.747585 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:47.747629 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:47.747988 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:47.748328 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:47.749162 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:47.750172 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:47.751112 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:47.751663 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:47.751832 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:47.754468 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:47.754476 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:47.754493 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:47.754538 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:47.756919 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:47.757385 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:47.757392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:47.757398 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:47.757568 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:47.757866 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:47.757870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:47.757872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:47.758443 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:47.758667 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:47.759031 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 02:16:47.759369 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":142,"threads_started":1}
I20260807 02:16:47.763166 2399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a857c1872804276be55d1db24d062d0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41789 } }
I20260807 02:16:47.763453 2399 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:47.763497 2399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a857c1872804276be55d1db24d062d0, State: Initialized, Role: FOLLOWER
I20260807 02:16:47.763935 2399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a857c1872804276be55d1db24d062d0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41789 } }
I20260807 02:16:47.764081 2399 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:16:47.764133 2399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:16:47.764212 2399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:47.765183 2399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a857c1872804276be55d1db24d062d0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41789 } }
I20260807 02:16:47.765525 2399 leader_election.cc:302] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a857c1872804276be55d1db24d062d0; no voters:
I20260807 02:16:47.765805 2399 leader_election.cc:288] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:16:47.765934 2405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:47.766165 2405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [term 1 LEADER]: Becoming Leader. State: Replica: 5a857c1872804276be55d1db24d062d0, State: Running, Role: LEADER
I20260807 02:16:47.766475 2405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a857c1872804276be55d1db24d062d0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41789 } }
I20260807 02:16:47.767305 2399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:16:47.768848 2407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a857c1872804276be55d1db24d062d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a857c1872804276be55d1db24d062d0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41789 } } }
I20260807 02:16:47.769024 2407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:47.768853 2408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a857c1872804276be55d1db24d062d0. Latest consensus state: current_term: 1 leader_uuid: "5a857c1872804276be55d1db24d062d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a857c1872804276be55d1db24d062d0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41789 } } }
I20260807 02:16:47.769387 2408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:47.769770 2415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:16:47.772786 2415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:16:47.780507 2415 catalog_manager.cc:1347] Generated new cluster ID: c27fb7c516c14784869e9d25daab77c3
I20260807 02:16:47.780593 2415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:16:47.796329 2415 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:16:47.797662 2415 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:16:47.811883 2415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a857c1872804276be55d1db24d062d0: Generated new TSK 0
I20260807 02:16:47.812803 2415 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:16:47.841764 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41789
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:47.960108 2432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:47.960381 2432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:47.960455 2432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:47.964473 2432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:47.964541 2432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:47.964633 2432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:16:47.970222 2432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41789
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:47.971345 2432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:47.972419 2432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:47.982576 2443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:47.982568 2441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:47.982568 2446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:47.982842 2432 server_base.cc:1034] running on GCE node
I20260807 02:16:47.983374 2432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:47.984010 2432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:47.985183 2432 hybrid_clock.cc:648] HybridClock initialized: now 1786069007985162 us; error 33 us; skew 500 ppm
Aug 07 02:16:47 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:47.988081 2432 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:16:47.989019 2432 webserver.cc:460] Webserver started at http://127.1.126.193:38635/ using document root <none> and password file <none>
I20260807 02:16:47.989596 2432 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:47.989687 2432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:47.989893 2432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:47.992110 2432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "1b9cd5684f8149d291f1e216383877b8"
format_stamp: "Formatted at 2026-08-07 02:16:47 on dist-test-slave-39l8"
server_key: "89d1c58db5b10f2a5d6dc33f30973abe"
server_key_iv: "d0b5e7f202e9b23cdd5222b99422a228"
server_key_version: "encryptionkey@0"
I20260807 02:16:47.992648 2432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "1b9cd5684f8149d291f1e216383877b8"
format_stamp: "Formatted at 2026-08-07 02:16:47 on dist-test-slave-39l8"
server_key: "89d1c58db5b10f2a5d6dc33f30973abe"
server_key_iv: "d0b5e7f202e9b23cdd5222b99422a228"
server_key_version: "encryptionkey@0"
I20260807 02:16:47.996704 2432 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 02:16:47.999365 2462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.000608 2432 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:16:48.000732 2432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "1b9cd5684f8149d291f1e216383877b8"
format_stamp: "Formatted at 2026-08-07 02:16:47 on dist-test-slave-39l8"
server_key: "89d1c58db5b10f2a5d6dc33f30973abe"
server_key_iv: "d0b5e7f202e9b23cdd5222b99422a228"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.000824 2432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:48.015348 2432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:48.019538 2432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:48.019754 2432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:48.020396 2432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:16:48.021287 2432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:48.021337 2432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.021416 2432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:48.021446 2432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.030197 2432 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:44623
I20260807 02:16:48.030223 2635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:44623 every 8 connection(s)
I20260807 02:16:48.031279 2432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:16:48.039887 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 2432
I20260807 02:16:48.040019 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:16:48.040328 1531 external_mini_cluster.cc:1428] Setting key a3fbefa79f9b25007747e9151abd1094
Aug 07 02:16:48 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:48.045913 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.033219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:59689 (local address 127.1.126.254:41789)
0807 02:16:48.033362 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.033365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.034262 (+ 897us) server_negotiation.cc:407] Connection header received
0807 02:16:48.035895 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.035899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.035961 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.036057 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:48.037265 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.037825 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.039045 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.039304 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.039414 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.042191 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:48.042195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:48.042197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:48.042220 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:48.043785 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.044333 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.044336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.044337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.044417 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.044775 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.044779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.044781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.044964 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:48.045074 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.045590 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.045734 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:16:48.046780 2638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.033594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41789 (local address 127.1.126.193:59689)
0807 02:16:48.034077 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.034149 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.035653 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.036249 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.036256 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.036613 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:48.037106 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.037119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.037962 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.037965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.038923 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.038934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.039479 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.039483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.039645 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.040282 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:48.040298 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:48.042014 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:48.043916 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:48.043923 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:48.043939 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:48.044214 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:48.044523 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:48.044526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:48.044528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:48.044678 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:48.045074 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:48.045083 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:48.045345 (+ 262us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.045546 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.045881 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":139,"threads_started":1}
I20260807 02:16:48.048044 2636 heartbeater.cc:347] Connected to a master server at 127.1.126.254:41789
I20260807 02:16:48.048307 2636 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:48.048857 2636 heartbeater.cc:511] Master 127.1.126.254:41789 requested a full tablet report, sending...
I20260807 02:16:48.050681 2346 ts_manager.cc:194] Registered new tserver with Master: 1b9cd5684f8149d291f1e216383877b8 (127.1.126.193:44623)
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:16:48.052111 2346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:59689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:16:48.069232 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41789
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:48.198915 2642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:48.199232 2642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:48.199331 2642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:48.203928 2642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:48.203990 2642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:48.204102 2642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:16:48.210175 2642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41789
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:48.211587 2642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:48.212786 2642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:48.223073 2653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:48.223027 2649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:48.223053 2650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:48.223198 2642 server_base.cc:1034] running on GCE node
I20260807 02:16:48.223670 2642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:48.224318 2642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:48.225502 2642 hybrid_clock.cc:648] HybridClock initialized: now 1786069008225485 us; error 28 us; skew 500 ppm
Aug 07 02:16:48 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:48.228376 2642 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:16:48.229252 2642 webserver.cc:460] Webserver started at http://127.1.126.194:38105/ using document root <none> and password file <none>
I20260807 02:16:48.229851 2642 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:48.229943 2642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:48.230181 2642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:48.232390 2642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "a1f040556fc44f989ffa7d4c9a39ac02"
format_stamp: "Formatted at 2026-08-07 02:16:48 on dist-test-slave-39l8"
server_key: "ced821ad431abcbad3de383ebded8b5c"
server_key_iv: "2a81c980d5c94e39632d113572eb6480"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.232990 2642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "a1f040556fc44f989ffa7d4c9a39ac02"
format_stamp: "Formatted at 2026-08-07 02:16:48 on dist-test-slave-39l8"
server_key: "ced821ad431abcbad3de383ebded8b5c"
server_key_iv: "2a81c980d5c94e39632d113572eb6480"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.236989 2642 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 02:16:48.239547 2661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.240846 2642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:48.241009 2642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "a1f040556fc44f989ffa7d4c9a39ac02"
format_stamp: "Formatted at 2026-08-07 02:16:48 on dist-test-slave-39l8"
server_key: "ced821ad431abcbad3de383ebded8b5c"
server_key_iv: "2a81c980d5c94e39632d113572eb6480"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.241137 2642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:48.265682 2642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:48.268914 2642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:48.269124 2642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:48.269853 2642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:16:48.270818 2642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:48.270884 2642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.270951 2642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:48.270980 2642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.280028 2642 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42579
I20260807 02:16:48.280053 2817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42579 every 8 connection(s)
I20260807 02:16:48.280937 2642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:16:48.287376 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 2642
I20260807 02:16:48.287503 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:16:48.287801 1531 external_mini_cluster.cc:1428] Setting key e4f20b8769309690f9f4121497c7a176
Aug 07 02:16:48 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:48.296166 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.282982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:47829 (local address 127.1.126.254:41789)
0807 02:16:48.283116 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.283125 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.283942 (+ 817us) server_negotiation.cc:407] Connection header received
0807 02:16:48.285319 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.285322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.285373 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.285452 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:48.286579 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.287179 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.288691 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.288925 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.289019 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.291993 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:48.291997 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:48.291998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:48.292033 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:48.293547 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.294224 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.294228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.294229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.294313 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.294802 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.294805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.294806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.295025 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:48.295120 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.295886 (+ 766us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.296026 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:16:48.297617 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.283334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41789 (local address 127.1.126.194:47829)
0807 02:16:48.283784 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.283826 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.285095 (+ 1269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.285627 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.285633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.285977 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:48.286452 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.286465 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.287325 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.287330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.288559 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.288569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.289088 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.289095 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.289279 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.289893 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:48.289919 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:48.291806 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:48.293689 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:48.293699 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:48.293720 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:48.294095 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:48.294410 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:48.294416 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:48.294421 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:48.294629 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:48.295165 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:48.295177 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:48.295592 (+ 415us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.295843 (+ 251us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.296245 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":105,"threads_started":1}
I20260807 02:16:48.299074 2818 heartbeater.cc:347] Connected to a master server at 127.1.126.254:41789
I20260807 02:16:48.299342 2818 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:48.299870 2818 heartbeater.cc:511] Master 127.1.126.254:41789 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:16:48.301074 2346 ts_manager.cc:194] Registered new tserver with Master: a1f040556fc44f989ffa7d4c9a39ac02 (127.1.126.194:42579)
I20260807 02:16:48.301647 2346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:47829
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:16:48.320344 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41789
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:48.443851 2824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:48.444178 2824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:48.444303 2824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:48.449082 2824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:48.449155 2824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:48.449263 2824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:16:48.455216 2824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41789
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:48.456450 2824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:48.457743 2824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:48.468256 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:48.468194 2829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:48.468226 2831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:48.468498 2824 server_base.cc:1034] running on GCE node
I20260807 02:16:48.469009 2824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:48.469731 2824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:48.470980 2824 hybrid_clock.cc:648] HybridClock initialized: now 1786069008470945 us; error 45 us; skew 500 ppm
Aug 07 02:16:48 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:48.473990 2824 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:16:48.475008 2824 webserver.cc:460] Webserver started at http://127.1.126.195:45191/ using document root <none> and password file <none>
I20260807 02:16:48.475597 2824 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:48.475659 2824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:48.475835 2824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:48.477921 2824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "fb692b33782f4d31bf01e57df43daeed"
format_stamp: "Formatted at 2026-08-07 02:16:48 on dist-test-slave-39l8"
server_key: "c16040286998762c5a062ba8e72901e6"
server_key_iv: "e6ca161804a43779733a14fff10e8b31"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.478464 2824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "fb692b33782f4d31bf01e57df43daeed"
format_stamp: "Formatted at 2026-08-07 02:16:48 on dist-test-slave-39l8"
server_key: "c16040286998762c5a062ba8e72901e6"
server_key_iv: "e6ca161804a43779733a14fff10e8b31"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.482470 2824 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:16:48.485598 2844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.487030 2824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:16:48.487174 2824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "fb692b33782f4d31bf01e57df43daeed"
format_stamp: "Formatted at 2026-08-07 02:16:48 on dist-test-slave-39l8"
server_key: "c16040286998762c5a062ba8e72901e6"
server_key_iv: "e6ca161804a43779733a14fff10e8b31"
server_key_version: "encryptionkey@0"
I20260807 02:16:48.487295 2824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:48.517881 2824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:48.521003 2824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:48.521222 2824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:48.521900 2824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:16:48.522852 2824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:48.522925 2824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.523000 2824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:48.523041 2824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:48.532456 2824 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:33999
I20260807 02:16:48.532492 2995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:33999 every 8 connection(s)
I20260807 02:16:48.533423 2824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:16:48.538560 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 2824
I20260807 02:16:48.538707 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:16:48.539027 1531 external_mini_cluster.cc:1428] Setting key eb4a6a0243b25c06702c0182cd032bcc
Aug 07 02:16:48 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:48.547804 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.535455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:43379 (local address 127.1.126.254:41789)
0807 02:16:48.535635 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.535639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.536436 (+ 797us) server_negotiation.cc:407] Connection header received
0807 02:16:48.537827 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.537830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.537889 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.537990 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:48.539314 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.539982 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.541308 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.541525 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.541634 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.544109 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:48.544113 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:48.544116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:48.544146 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:48.545678 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.546224 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.546228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.546230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.546312 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.546655 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.546659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.546661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.546898 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:48.547006 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.547515 (+ 509us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.547638 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:16:48.548676 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.535845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41789 (local address 127.1.126.195:43379)
0807 02:16:48.536284 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.536327 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.537611 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.538170 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.538177 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.538518 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:48.539176 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.539192 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.540115 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.540119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.541178 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.541194 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.541687 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.541691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.541873 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.542395 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:48.542411 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:48.543935 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:48.545796 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:48.545802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:48.545818 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:48.546109 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:48.546413 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:48.546416 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:48.546418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:48.546559 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:48.547004 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:48.547011 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:48.547277 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.547471 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.547819 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":104,"threads_started":1}
I20260807 02:16:48.549813 2996 heartbeater.cc:347] Connected to a master server at 127.1.126.254:41789
I20260807 02:16:48.550072 2996 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:48.550596 2996 heartbeater.cc:511] Master 127.1.126.254:41789 requested a full tablet report, sending...
I20260807 02:16:48.551852 2346 ts_manager.cc:194] Registered new tserver with Master: fb692b33782f4d31bf01e57df43daeed (127.1.126.195:33999)
I20260807 02:16:48.552625 2346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:43379
I20260807 02:16:48.553121 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:16:48.564985 2403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.557769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.1.126.254:41789)
0807 02:16:48.557896 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.557899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.558114 (+ 215us) server_negotiation.cc:407] Connection header received
0807 02:16:48.558219 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.558221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.558260 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.558329 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:48.559098 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.559598 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.560406 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.560625 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.560702 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.562007 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:48.562011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:48.562013 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:48.562036 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:48.563519 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.563941 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.563944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.563945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.564024 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:48.564252 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:48.564254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:48.564255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:48.564462 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:48.564568 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.564761 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.564864 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:16:48.571041 2346 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:16:48.574368 2346 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:48.590539 3013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.584382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58026 (local address 127.1.126.195:33999)
0807 02:16:48.585593 (+ 1211us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.585608 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.585636 (+ 28us) server_negotiation.cc:407] Connection header received
0807 02:16:48.585723 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.585729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.585945 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.586134 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:48.586479 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.587377 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.589129 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.589759 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.589905 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.590088 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.590259 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.590363 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1107,"thread_start_us":159,"threads_started":1}
I20260807 02:16:48.590543 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.584269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:33999 (local address 127.0.0.1:58026)
0807 02:16:48.584608 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.584655 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.584789 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.586137 (+ 1348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.586143 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.586166 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:48.586330 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.586341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.587507 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.587512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.588971 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.588983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.589906 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.589910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.590031 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.590073 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.590223 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.590357 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":23,"thread_start_us":87,"threads_started":1}
I20260807 02:16:48.592083 3012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.584366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42579 (local address 127.0.0.1:52902)
0807 02:16:48.585042 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.585057 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.585140 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.586332 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.586339 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.586361 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:48.586513 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.586520 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.588016 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.588019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.589245 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.589256 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.590516 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.590520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.591779 (+ 1259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.591805 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.591857 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.591926 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"mutex_wait_us":62,"thread_start_us":108,"threads_started":1}
I20260807 02:16:48.592417 3016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.585126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:44623 (local address 127.0.0.1:41888)
0807 02:16:48.585546 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.585558 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.585642 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.586374 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.586380 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.586405 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:48.586542 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.586548 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.588010 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.588014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.590696 (+ 2682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.590733 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.592022 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.592025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.592120 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.592151 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.592228 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.592295 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":47,"thread_start_us":92,"threads_started":1}
I20260807 02:16:48.592787 3017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.585091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52902 (local address 127.1.126.194:42579)
0807 02:16:48.585680 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.585696 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.585721 (+ 25us) server_negotiation.cc:407] Connection header received
0807 02:16:48.585799 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.585804 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.585977 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.586143 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:48.586639 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.587868 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.589389 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.590351 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.592283 (+ 1932us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.592421 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.592478 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.592584 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":138,"threads_started":1}
I20260807 02:16:48.592955 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.585564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41888 (local address 127.1.126.193:44623)
0807 02:16:48.585963 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.585970 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.585996 (+ 26us) server_negotiation.cc:407] Connection header received
0807 02:16:48.586072 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.586076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.586241 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.586384 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:48.586674 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.587858 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.590874 (+ 3016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.591690 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.591800 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.591946 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.592674 (+ 728us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.592793 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":106,"threads_started":1}
I20260807 02:16:48.594411 2908 tablet_service.cc:1467] Processing CreateTablet for tablet f89bdc48d6f04aae84963fde78e2fb06 (DEFAULT_TABLE table=test-table [id=ead08a3610454523823d2fb7154855f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:48.595496 2533 tablet_service.cc:1467] Processing CreateTablet for tablet f89bdc48d6f04aae84963fde78e2fb06 (DEFAULT_TABLE table=test-table [id=ead08a3610454523823d2fb7154855f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:48.596009 2908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f89bdc48d6f04aae84963fde78e2fb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:48.596422 2533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f89bdc48d6f04aae84963fde78e2fb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:48.596604 2734 tablet_service.cc:1467] Processing CreateTablet for tablet f89bdc48d6f04aae84963fde78e2fb06 (DEFAULT_TABLE table=test-table [id=ead08a3610454523823d2fb7154855f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:48.597843 2734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f89bdc48d6f04aae84963fde78e2fb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:48.603277 3021 tablet_bootstrap.cc:492] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: Bootstrap starting.
I20260807 02:16:48.604725 3022 tablet_bootstrap.cc:492] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: Bootstrap starting.
I20260807 02:16:48.604837 3023 tablet_bootstrap.cc:492] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: Bootstrap starting.
I20260807 02:16:48.606033 3021 tablet_bootstrap.cc:654] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:48.607020 3021 log.cc:824] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:48.607391 3022 tablet_bootstrap.cc:654] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:48.607717 3023 tablet_bootstrap.cc:654] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:48.608203 3022 log.cc:824] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:48.608515 3023 log.cc:824] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:48.609462 3021 tablet_bootstrap.cc:492] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: No bootstrap required, opened a new log
I20260807 02:16:48.609683 3021 ts_tablet_manager.cc:1397] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 02:16:48.610543 3023 tablet_bootstrap.cc:492] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: No bootstrap required, opened a new log
I20260807 02:16:48.610599 3022 tablet_bootstrap.cc:492] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: No bootstrap required, opened a new log
I20260807 02:16:48.610785 3023 ts_tablet_manager.cc:1397] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:16:48.610809 3022 ts_tablet_manager.cc:1397] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:16:48.613605 3021 raft_consensus.cc:348] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.613860 3021 raft_consensus.cc:374] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:48.613915 3021 raft_consensus.cc:729] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9cd5684f8149d291f1e216383877b8, State: Initialized, Role: FOLLOWER
I20260807 02:16:48.614374 3021 consensus_queue.cc:260] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.614843 3023 raft_consensus.cc:348] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.615123 3023 raft_consensus.cc:374] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:48.615176 3023 raft_consensus.cc:729] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1f040556fc44f989ffa7d4c9a39ac02, State: Initialized, Role: FOLLOWER
I20260807 02:16:48.615170 2636 heartbeater.cc:503] Master 127.1.126.254:41789 was elected leader, sending a full tablet report...
I20260807 02:16:48.615554 3021 ts_tablet_manager.cc:1428] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:16:48.615556 3023 consensus_queue.cc:260] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.615948 3022 raft_consensus.cc:348] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.616220 3022 raft_consensus.cc:374] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:48.616281 3022 raft_consensus.cc:729] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb692b33782f4d31bf01e57df43daeed, State: Initialized, Role: FOLLOWER
I20260807 02:16:48.616532 3023 ts_tablet_manager.cc:1428] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:16:48.616581 2818 heartbeater.cc:503] Master 127.1.126.254:41789 was elected leader, sending a full tablet report...
I20260807 02:16:48.616806 3022 consensus_queue.cc:260] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.617507 2996 heartbeater.cc:503] Master 127.1.126.254:41789 was elected leader, sending a full tablet report...
I20260807 02:16:48.617854 3022 ts_tablet_manager.cc:1428] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260807 02:16:48.782320 2819 tablet.cc:2369] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:16:48.782781 2637 tablet.cc:2369] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:16:48.784340 2997 tablet.cc:2369] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:16:48.965145 3028 raft_consensus.cc:482] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:48.965408 3028 raft_consensus.cc:504] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.966660 3028 leader_election.cc:288] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb692b33782f4d31bf01e57df43daeed (127.1.126.195:33999), a1f040556fc44f989ffa7d4c9a39ac02 (127.1.126.194:42579)
I20260807 02:16:48.972499 3013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.967105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:39929 (local address 127.1.126.195:33999)
0807 02:16:48.967283 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.967289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.967635 (+ 346us) server_negotiation.cc:407] Connection header received
0807 02:16:48.967796 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.967803 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.967879 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.967961 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:48.968320 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.969149 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.971055 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.971740 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.971856 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.971906 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.972275 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.972357 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 02:16:48.972499 3017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.967180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:48863 (local address 127.1.126.194:42579)
0807 02:16:48.967315 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:48.967322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:48.967738 (+ 416us) server_negotiation.cc:407] Connection header received
0807 02:16:48.967934 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:48.967938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:48.967995 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:48.968073 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:48.968322 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.969149 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.971023 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.971689 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.971845 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.971906 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:48.972275 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 02:16:48.972356 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 02:16:48.972656 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.967007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42579 (local address 127.1.126.193:48863)
0807 02:16:48.967615 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.967631 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.967816 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.968087 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.968089 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.968104 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:48.968218 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.968227 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.969281 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.969285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.970867 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.970880 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.971854 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.971858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.972041 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.972132 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.972226 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.972374 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":201,"thread_start_us":159,"threads_started":1}
I20260807 02:16:48.972811 3033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:48.967008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:33999 (local address 127.1.126.193:39929)
0807 02:16:48.967530 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:48.967544 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:48.967652 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:48.967979 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:48.967982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:48.967996 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:48.968152 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.968161 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.969281 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.969285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.970867 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:48.970880 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:48.971854 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:48.971858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:48.972066 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:48.972128 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 02:16:48.972236 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 02:16:48.972378 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":257,"thread_start_us":126,"threads_started":1}
I20260807 02:16:48.973568 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f89bdc48d6f04aae84963fde78e2fb06" candidate_uuid: "1b9cd5684f8149d291f1e216383877b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" is_pre_election: true
I20260807 02:16:48.973958 2757 raft_consensus.cc:2454] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b9cd5684f8149d291f1e216383877b8 in term 0.
I20260807 02:16:48.974545 2463 leader_election.cc:302] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9cd5684f8149d291f1e216383877b8, a1f040556fc44f989ffa7d4c9a39ac02; no voters:
I20260807 02:16:48.974858 3028 raft_consensus.cc:2781] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:48.974972 3028 raft_consensus.cc:482] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:48.975052 3028 raft_consensus.cc:3037] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:48.975308 2935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f89bdc48d6f04aae84963fde78e2fb06" candidate_uuid: "1b9cd5684f8149d291f1e216383877b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb692b33782f4d31bf01e57df43daeed" is_pre_election: true
I20260807 02:16:48.975642 2935 raft_consensus.cc:2454] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b9cd5684f8149d291f1e216383877b8 in term 0.
I20260807 02:16:48.976467 3028 raft_consensus.cc:504] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.976835 3028 leader_election.cc:288] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [CANDIDATE]: Term 1 election: Requested vote from peers fb692b33782f4d31bf01e57df43daeed (127.1.126.195:33999), a1f040556fc44f989ffa7d4c9a39ac02 (127.1.126.194:42579)
I20260807 02:16:48.977254 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f89bdc48d6f04aae84963fde78e2fb06" candidate_uuid: "1b9cd5684f8149d291f1e216383877b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1f040556fc44f989ffa7d4c9a39ac02"
I20260807 02:16:48.977252 2935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f89bdc48d6f04aae84963fde78e2fb06" candidate_uuid: "1b9cd5684f8149d291f1e216383877b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb692b33782f4d31bf01e57df43daeed"
I20260807 02:16:48.977384 2935 raft_consensus.cc:3037] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:48.977384 2757 raft_consensus.cc:3037] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:48.978675 2935 raft_consensus.cc:2454] T f89bdc48d6f04aae84963fde78e2fb06 P fb692b33782f4d31bf01e57df43daeed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b9cd5684f8149d291f1e216383877b8 in term 1.
I20260807 02:16:48.978669 2757 raft_consensus.cc:2454] T f89bdc48d6f04aae84963fde78e2fb06 P a1f040556fc44f989ffa7d4c9a39ac02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b9cd5684f8149d291f1e216383877b8 in term 1.
I20260807 02:16:48.979030 2465 leader_election.cc:302] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9cd5684f8149d291f1e216383877b8, fb692b33782f4d31bf01e57df43daeed; no voters:
I20260807 02:16:48.979269 3028 raft_consensus.cc:2781] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:48.979463 3028 raft_consensus.cc:686] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1b9cd5684f8149d291f1e216383877b8, State: Running, Role: LEADER
I20260807 02:16:48.979838 3028 consensus_queue.cc:237] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } }
I20260807 02:16:48.983487 2346 catalog_manager.cc:5495] T f89bdc48d6f04aae84963fde78e2fb06 P 1b9cd5684f8149d291f1e216383877b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b9cd5684f8149d291f1e216383877b8 (127.1.126.193). New cstate: current_term: 1 leader_uuid: "1b9cd5684f8149d291f1e216383877b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb692b33782f4d31bf01e57df43daeed" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1f040556fc44f989ffa7d4c9a39ac02" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b9cd5684f8149d291f1e216383877b8" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44623 } health_report { overall_health: HEALTHY } } }
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:16:49.049824 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:49.037199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41892 (local address 127.1.126.193:44623)
0807 02:16:49.037354 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:49.037359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:49.037561 (+ 202us) server_negotiation.cc:407] Connection header received
0807 02:16:49.037674 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:49.037677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:49.037721 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:49.037791 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:49.038609 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:49.039134 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:49.040313 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:49.040515 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:49.040589 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:49.046105 (+ 5516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:49.046115 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:49.046132 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:49.046159 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:49.047986 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:49.048454 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:49.048460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:49.048461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:49.048546 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:49.048801 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:49.048803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:49.048804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:49.049077 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:49.049239 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:49.049475 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 02:16:49.049604 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069009, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069009, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:16:49.079757 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:49.071016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41904 (local address 127.1.126.193:44623)
0807 02:16:49.071217 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:49.071222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:49.071295 (+ 73us) server_negotiation.cc:407] Connection header received
0807 02:16:49.071460 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:49.071464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:49.071514 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:49.071597 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:49.072304 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:49.072836 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:49.073667 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:49.073900 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:49.073988 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:49.076639 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:49.076642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:49.076644 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:49.076669 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:49.077959 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:49.078357 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:49.078360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:49.078361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:49.078439 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:49.078698 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:49.078700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:49.078701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:49.078942 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:49.079051 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:49.079386 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 02:16:49.079557 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[2275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[2275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:16:49.110105 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:49.101114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41908 (local address 127.1.126.193:44623)
0807 02:16:49.101268 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:49.101271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:49.101510 (+ 239us) server_negotiation.cc:407] Connection header received
0807 02:16:49.101694 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:49.101703 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:49.101759 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:49.101846 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:49.102576 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:49.103214 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:49.104098 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:49.104406 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:49.104519 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:49.107215 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:49.107218 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:49.107220 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:49.107247 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:49.108579 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:49.109009 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:49.109011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:49.109013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:49.109087 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:49.109317 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:49.109319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:49.109320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:49.109504 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:49.109601 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:49.109865 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 02:16:49.109971 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 02:16:49.111847 2505 tablet_service.cc:2908] Rejecting scan request for tablet f89bdc48d6f04aae84963fde78e2fb06: Uninitialized: clean time has not yet been initialized
I20260807 02:16:49.114145 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 2432
I20260807 02:16:49.129948 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 2642
I20260807 02:16:49.140777 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 2824
I20260807 02:16:49.159106 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 2301
2026-08-07T02:16:49Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2955 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[3055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[3055](info): set up 2 sockets
Aug 07 02:16:49 dist-test-slave-39l8 krb5kdc[3055](info): commencing operation
krb5kdc: starting...
W20260807 02:16:50.417126 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:16:50 dist-test-slave-39l8 krb5kdc[3055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:16:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:16:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:16:50.548009 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45485
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:50.664386 3075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:50.664713 3075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:50.664791 3075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:50.668901 3075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:16:50.668994 3075 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 02:16:50.669035 3075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:50.669093 3075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:50.669135 3075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:16:50.669173 3075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:16:50.674767 3075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45485
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:50.675958 3075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:50.677057 3075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:50.686007 3084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:50.685951 3083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:50.686069 3075 server_base.cc:1034] running on GCE node
W20260807 02:16:50.685983 3087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:50.686915 3075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:50.688094 3075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:50.689263 3075 hybrid_clock.cc:648] HybridClock initialized: now 1786069010689234 us; error 42 us; skew 500 ppm
Aug 07 02:16:50 dist-test-slave-39l8 krb5kdc[3055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069010, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:50.692291 3075 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:16:50.693210 3075 webserver.cc:460] Webserver started at http://127.1.126.254:40943/ using document root <none> and password file <none>
I20260807 02:16:50.693745 3075 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:50.693804 3075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:50.693969 3075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:50.696112 3075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "623719d7e04346558336273816a2f7bc"
format_stamp: "Formatted at 2026-08-07 02:16:50 on dist-test-slave-39l8"
server_key: "61dc76f2de4e3f7c63f97283ce1d6b87"
server_key_iv: "776b496445558938c656b8101779b9b2"
server_key_version: "encryptionkey@0"
I20260807 02:16:50.696664 3075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "623719d7e04346558336273816a2f7bc"
format_stamp: "Formatted at 2026-08-07 02:16:50 on dist-test-slave-39l8"
server_key: "61dc76f2de4e3f7c63f97283ce1d6b87"
server_key_iv: "776b496445558938c656b8101779b9b2"
server_key_version: "encryptionkey@0"
I20260807 02:16:50.700362 3075 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 02:16:50.702776 3096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:50.703971 3075 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:16:50.704114 3075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "623719d7e04346558336273816a2f7bc"
format_stamp: "Formatted at 2026-08-07 02:16:50 on dist-test-slave-39l8"
server_key: "61dc76f2de4e3f7c63f97283ce1d6b87"
server_key_iv: "776b496445558938c656b8101779b9b2"
server_key_version: "encryptionkey@0"
I20260807 02:16:50.704226 3075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:50.765360 3075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:50.768978 3075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:50.769213 3075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:50.778245 3075 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45485
I20260807 02:16:50.778273 3181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45485 every 8 connection(s)
I20260807 02:16:50.779305 3075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:16:50.782241 3182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:50.785847 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 3075
I20260807 02:16:50.785993 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:16:50.786273 1531 external_mini_cluster.cc:1428] Setting key 4bf65cd8f464155649d358a9e43741ad
I20260807 02:16:50.788887 3182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: Bootstrap starting.
I20260807 02:16:50.791838 3182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:50.792759 3182 log.cc:824] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:50.795150 3182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: No bootstrap required, opened a new log
Aug 07 02:16:50 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:50.800091 3182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623719d7e04346558336273816a2f7bc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45485 } }
I20260807 02:16:50.800418 3182 raft_consensus.cc:374] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:50.800483 3182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 623719d7e04346558336273816a2f7bc, State: Initialized, Role: FOLLOWER
I20260807 02:16:50.800998 3182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623719d7e04346558336273816a2f7bc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45485 } }
I20260807 02:16:50.801174 3182 raft_consensus.cc:388] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:16:50.801258 3182 raft_consensus.cc:482] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:16:50.801360 3182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:50.802575 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:50.787853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34908 (local address 127.1.126.254:45485)
0807 02:16:50.788337 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:50.788363 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:50.788408 (+ 45us) server_negotiation.cc:407] Connection header received
0807 02:16:50.789302 (+ 894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:50.789326 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:50.789750 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:50.790122 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:50.790888 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:50.792440 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:50.793405 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:50.793944 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:50.794070 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:50.797122 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:50.797128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:50.797146 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:50.797180 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:50.799291 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:50.799732 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:50.799738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:50.799744 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:50.799904 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:50.800181 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:50.800189 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:50.800191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:50.800762 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:50.800974 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:50.801201 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 02:16:50.801536 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":143,"threads_started":1}
I20260807 02:16:50.802546 3182 raft_consensus.cc:504] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623719d7e04346558336273816a2f7bc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45485 } }
I20260807 02:16:50.802953 3182 leader_election.cc:302] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 623719d7e04346558336273816a2f7bc; no voters:
I20260807 02:16:50.803290 3182 leader_election.cc:288] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:16:50.803409 3191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:50.803648 3191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [term 1 LEADER]: Becoming Leader. State: Replica: 623719d7e04346558336273816a2f7bc, State: Running, Role: LEADER
I20260807 02:16:50.803967 3191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623719d7e04346558336273816a2f7bc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45485 } }
I20260807 02:16:50.804574 3182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:16:50.805512 3195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 623719d7e04346558336273816a2f7bc. Latest consensus state: current_term: 1 leader_uuid: "623719d7e04346558336273816a2f7bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623719d7e04346558336273816a2f7bc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45485 } } }
I20260807 02:16:50.805665 3195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:50.806046 3208 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:16:50.807034 3193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "623719d7e04346558336273816a2f7bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623719d7e04346558336273816a2f7bc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45485 } } }
I20260807 02:16:50.807147 3193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:50.809135 3208 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:16:50.815547 3208 catalog_manager.cc:1347] Generated new cluster ID: 99802558d50845d6ae4486ac362cb082
I20260807 02:16:50.815637 3208 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:16:50.832937 3208 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:16:50.833928 3208 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:16:50.851034 3208 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: Generated new TSK 0
I20260807 02:16:50.851857 3208 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:16:50.893481 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:45485
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:51.010991 3224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:51.011273 3224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:51.011358 3224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:51.015507 3224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:51.015568 3224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:51.015625 3224 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:16:51.015692 3224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:16:51.021199 3224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:45485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:51.022260 3224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:51.023375 3224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:51.033456 3231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:51.033516 3235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:51.033504 3224 server_base.cc:1034] running on GCE node
W20260807 02:16:51.033439 3232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:51.034093 3224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:51.034739 3224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:51.035916 3224 hybrid_clock.cc:648] HybridClock initialized: now 1786069011035897 us; error 27 us; skew 500 ppm
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:51.038641 3224 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:16:51.039567 3224 webserver.cc:460] Webserver started at http://127.1.126.193:39343/ using document root <none> and password file <none>
I20260807 02:16:51.040148 3224 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:51.040235 3224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:51.040463 3224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:51.042548 3224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "31296b5d5b7b449db53d28641861ea17"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "4279c44b9facd249bb90cef4e7ee7cf1"
server_key_iv: "cc82edd61ea526afcebd0f6748524898"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.043182 3224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "31296b5d5b7b449db53d28641861ea17"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "4279c44b9facd249bb90cef4e7ee7cf1"
server_key_iv: "cc82edd61ea526afcebd0f6748524898"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.046936 3224 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:16:51.049439 3245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:51.050626 3224 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:51.050796 3224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "31296b5d5b7b449db53d28641861ea17"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "4279c44b9facd249bb90cef4e7ee7cf1"
server_key_iv: "cc82edd61ea526afcebd0f6748524898"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.050912 3224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:51.065068 3224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:51.068106 3224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:51.068306 3224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:51.069825 3224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:51.069896 3224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:51.069968 3224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:51.070020 3224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:51.081262 3224 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:46751
I20260807 02:16:51.081447 3428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:46751 every 8 connection(s)
I20260807 02:16:51.082401 3224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:16:51.084872 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.070560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:60791 (local address 127.1.126.254:45485)
0807 02:16:51.070732 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.070740 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.072636 (+ 1896us) server_negotiation.cc:407] Connection header received
0807 02:16:51.073934 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.073937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.073997 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.074103 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.075585 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.076167 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.077372 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.077628 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.077751 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.081212 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.081216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.081219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.081249 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.083022 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.083555 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.083558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.083560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.083639 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.083925 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.083928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.083930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.084101 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.084178 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.084609 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.084737 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:16:51.085613 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.071882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.1.126.193:60791)
0807 02:16:51.072460 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.072524 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.073685 (+ 1161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.074284 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.074291 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.074800 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:51.075439 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.075453 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.076299 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.076302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.077251 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.077261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.077801 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.077806 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.077975 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.079382 (+ 1407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:51.079399 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:51.081010 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:51.083167 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.083175 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.083191 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.083462 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.083708 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.083710 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.083711 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.083830 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.084187 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:51.084192 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:51.084402 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.084558 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.084796 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":119,"threads_started":1}
I20260807 02:16:51.087018 3429 heartbeater.cc:347] Connected to a master server at 127.1.126.254:45485
I20260807 02:16:51.087193 3429 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:51.087693 3429 heartbeater.cc:511] Master 127.1.126.254:45485 requested a full tablet report, sending...
I20260807 02:16:51.089409 3116 ts_manager.cc:194] Registered new tserver with Master: 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751)
I20260807 02:16:51.090870 3116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:60791
I20260807 02:16:51.091874 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 3224
I20260807 02:16:51.092018 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:16:51.092327 1531 external_mini_cluster.cc:1428] Setting key 6853ee61b586f86391bae4decdc456db
I20260807 02:16:51.096764 3441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.089057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.1.126.193:53547)
0807 02:16:51.089361 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.089376 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.089485 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.089770 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.089773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.089975 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:51.090110 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.090118 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.090918 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.090922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.091679 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.091688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.092208 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.092212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.092308 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.092841 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:51.092860 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:51.093303 (+ 443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:51.095083 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.095089 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.095094 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.095385 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.095662 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.095668 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.095673 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.095780 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.096136 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:51.096142 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:51.096257 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.096379 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.096550 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":101,"threads_started":1}
I20260807 02:16:51.096818 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.089196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:53547 (local address 127.1.126.254:45485)
0807 02:16:51.089321 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.089324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.089448 (+ 124us) server_negotiation.cc:407] Connection header received
0807 02:16:51.089618 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.089620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.089660 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.089726 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.090231 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.090795 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.091798 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.092076 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.092176 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.093447 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.093451 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.093454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.093475 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.094971 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.095487 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.095490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.095491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.095570 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.095874 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.095876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.095877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.096036 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.096125 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.096467 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.096609 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":50}
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:16:51.123651 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:45485
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:51.240072 3445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:51.240381 3445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:51.240480 3445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:51.244606 3445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:51.244691 3445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:51.244755 3445 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:16:51.244833 3445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:16:51.250788 3445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:45485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:51.251941 3445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:51.253062 3445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:51.263355 3451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:51.263372 3454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:51.263377 3457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:51.263455 3445 server_base.cc:1034] running on GCE node
I20260807 02:16:51.264086 3445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:51.264726 3445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:51.265918 3445 hybrid_clock.cc:648] HybridClock initialized: now 1786069011265902 us; error 40 us; skew 500 ppm
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:51.268810 3445 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:16:51.269744 3445 webserver.cc:460] Webserver started at http://127.1.126.194:42447/ using document root <none> and password file <none>
I20260807 02:16:51.270355 3445 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:51.270452 3445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:51.270692 3445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:51.272873 3445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "ccaa0e585d6b4828b1273f35d7a0e606"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "6ca7d55e510d543126bbc5caf576152c"
server_key_iv: "074cf062c0624d2fef25e07b7518ab2f"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.273478 3445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "ccaa0e585d6b4828b1273f35d7a0e606"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "6ca7d55e510d543126bbc5caf576152c"
server_key_iv: "074cf062c0624d2fef25e07b7518ab2f"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.277513 3445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 02:16:51.280002 3473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:51.281237 3445 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:16:51.281397 3445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "ccaa0e585d6b4828b1273f35d7a0e606"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "6ca7d55e510d543126bbc5caf576152c"
server_key_iv: "074cf062c0624d2fef25e07b7518ab2f"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.281519 3445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:51.294621 3445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:51.298182 3445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:51.298420 3445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:51.300017 3445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:51.300092 3445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:51.300174 3445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:51.300216 3445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:51.312345 3445 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:33119
I20260807 02:16:51.312866 3645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:33119 every 8 connection(s)
I20260807 02:16:51.313476 3445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:16:51.315706 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.300900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:55667 (local address 127.1.126.254:45485)
0807 02:16:51.301064 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.301069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.302209 (+ 1140us) server_negotiation.cc:407] Connection header received
0807 02:16:51.303397 (+ 1188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.303401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.303463 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.303571 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.305390 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.306328 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.307886 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.308205 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.308324 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.311772 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.311776 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.311779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.311812 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.313299 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.313891 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.313895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.313897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.314000 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.314461 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.314467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.314468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.314795 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.314889 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.315450 (+ 561us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.315570 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:16:51.316417 3487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.301340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.1.126.194:55667)
0807 02:16:51.302055 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.302108 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.303189 (+ 1081us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.303822 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.303833 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.304361 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:51.305215 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.305240 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.306484 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.306490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.307758 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.307769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.308386 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.308394 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.308659 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.309403 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:51.309426 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:51.311581 (+ 2155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:51.313423 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.313429 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.313444 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.313781 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.314110 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.314114 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.314116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.314289 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.314885 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:51.314891 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:51.315133 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.315300 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.315548 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":134,"threads_started":1}
I20260807 02:16:51.317597 3646 heartbeater.cc:347] Connected to a master server at 127.1.126.254:45485
I20260807 02:16:51.317764 3646 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:51.318266 3646 heartbeater.cc:511] Master 127.1.126.254:45485 requested a full tablet report, sending...
I20260807 02:16:51.319366 3118 ts_manager.cc:194] Registered new tserver with Master: ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119)
I20260807 02:16:51.320043 3118 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:55667
I20260807 02:16:51.321321 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 3445
I20260807 02:16:51.321446 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:16:51.321731 1531 external_mini_cluster.cc:1428] Setting key 468dff747b277e1b0c91efe0df5c3f06
I20260807 02:16:51.328125 3655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.319916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.1.126.194:33437)
0807 02:16:51.320273 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.320295 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.320454 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.320713 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.320718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.320922 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:51.321021 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.321026 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.322082 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.322088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.322839 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.322865 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.323409 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.323413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.323518 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.324138 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:51.324158 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:51.324692 (+ 534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:51.326448 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.326453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.326455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.326680 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.327047 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.327049 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.327051 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.327130 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.327700 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:51.327703 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:51.327784 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.327871 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.327983 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":103,"threads_started":1}
I20260807 02:16:51.328346 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.320050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:33437 (local address 127.1.126.254:45485)
0807 02:16:51.320188 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.320192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.320393 (+ 201us) server_negotiation.cc:407] Connection header received
0807 02:16:51.320564 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.320567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.320606 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.320671 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.321199 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.321939 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.322984 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.323280 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.323366 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.324836 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.324839 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.324841 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.324864 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.326333 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.326824 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.326831 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.326836 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.326937 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.327236 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.327242 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.327246 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.327585 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.327709 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.327959 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.328100 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:16:51.351245 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:45485
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:51.475947 3659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:51.476235 3659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:51.476281 3659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:51.480501 3659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:51.480564 3659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:51.480604 3659 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:16:51.480638 3659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:16:51.486744 3659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:45485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:51.487900 3659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:51.488988 3659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:51.499161 3665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:51.499146 3667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:51.499150 3669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:51.499531 3659 server_base.cc:1034] running on GCE node
I20260807 02:16:51.499994 3659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:51.500699 3659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:51.501905 3659 hybrid_clock.cc:648] HybridClock initialized: now 1786069011501887 us; error 33 us; skew 500 ppm
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:51.504840 3659 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:16:51.505944 3659 webserver.cc:460] Webserver started at http://127.1.126.195:42193/ using document root <none> and password file <none>
I20260807 02:16:51.506606 3659 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:51.506673 3659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:51.506968 3659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:51.509081 3659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "32462a556fbc4956bd0a766f2c779b67"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "c55ef9a98d4e6c707df0c09b2451f497"
server_key_iv: "3d3fee88ec54048ca56db6ad9c191464"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.509655 3659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "32462a556fbc4956bd0a766f2c779b67"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "c55ef9a98d4e6c707df0c09b2451f497"
server_key_iv: "3d3fee88ec54048ca56db6ad9c191464"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.513619 3659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 02:16:51.516306 3682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:51.517562 3659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 02:16:51.517745 3659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "32462a556fbc4956bd0a766f2c779b67"
format_stamp: "Formatted at 2026-08-07 02:16:51 on dist-test-slave-39l8"
server_key: "c55ef9a98d4e6c707df0c09b2451f497"
server_key_iv: "3d3fee88ec54048ca56db6ad9c191464"
server_key_version: "encryptionkey@0"
I20260807 02:16:51.517894 3659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:51.537331 3659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:51.540665 3659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:51.540831 3659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:51.542341 3659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:51.542423 3659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:51.542503 3659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:51.542549 3659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:51.554433 3659 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:39959
I20260807 02:16:51.554579 3849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:39959 every 8 connection(s)
I20260807 02:16:51.555606 3659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:16:51.557432 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.543318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:35155 (local address 127.1.126.254:45485)
0807 02:16:51.543461 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.543465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.544587 (+ 1122us) server_negotiation.cc:407] Connection header received
0807 02:16:51.545846 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.545850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.545915 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.546033 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.547680 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.548449 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.549860 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.550140 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.550262 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.553346 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.553350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.553353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.553384 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.555098 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.555751 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.555755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.555757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.555848 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.556299 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.556302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.556304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.556544 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.556670 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.557204 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.557310 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 02:16:51.558286 3693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.543870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.1.126.195:35155)
0807 02:16:51.544391 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.544439 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.545590 (+ 1151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.546260 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.546273 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.546829 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:51.547520 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.547537 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.548591 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.548594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.549722 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.549732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.550311 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.550316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.550493 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.551159 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:51.551176 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:51.553134 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:51.555225 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.555231 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.555246 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.555612 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.555960 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.555981 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.555984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.556170 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.556684 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:51.556689 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:51.556980 (+ 291us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.557147 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.557394 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":140,"threads_started":1}
I20260807 02:16:51.559510 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 3659
I20260807 02:16:51.559654 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:16:51.559783 3850 heartbeater.cc:347] Connected to a master server at 127.1.126.254:45485
I20260807 02:16:51.559942 3850 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:51.559976 1531 external_mini_cluster.cc:1428] Setting key ef74d383a764465a57daeab10e7bdebd
I20260807 02:16:51.560520 3850 heartbeater.cc:511] Master 127.1.126.254:45485 requested a full tablet report, sending...
I20260807 02:16:51.561619 3116 ts_manager.cc:194] Registered new tserver with Master: 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959)
I20260807 02:16:51.562425 3116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:35155
I20260807 02:16:51.569401 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.562281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:36707 (local address 127.1.126.254:45485)
0807 02:16:51.562820 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.562824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.562836 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:16:51.562879 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.562882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.562915 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.563003 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.563487 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.563992 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.564916 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.565148 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.565263 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.566303 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.566306 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.566309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.566333 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.567561 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.567990 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.567995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.567997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.568082 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.568532 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.568537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.568541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.568734 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.568854 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.569149 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.569260 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453}
I20260807 02:16:51.569417 3866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.562285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.1.126.195:36707)
0807 02:16:51.562570 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.562585 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.562680 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.563024 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.563027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.563243 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:51.563367 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.563373 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.564126 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.564129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.564792 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.564802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.565272 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.565276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.565372 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.565844 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:51.565855 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:51.566153 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:51.567677 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.567682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.567684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.567886 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.568178 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:51.568182 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:51.568184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:51.568300 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:51.568844 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:51.568848 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:51.568948 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.569079 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.569228 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":2,"thread_start_us":101,"threads_started":1}
I20260807 02:16:51.574029 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 02:16:51 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:51.601944 3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.593691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53684 (local address 127.1.126.254:45485)
0807 02:16:51.593836 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.593840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.593853 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:16:51.593897 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.593900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.593940 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.594037 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:51.594781 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.595310 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.596143 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.596373 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.596505 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.598983 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:51.598987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:51.598989 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:51.599013 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:51.600512 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.600925 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.600927 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.600928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.601002 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:51.601236 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:51.601238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:51.601239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:51.601410 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:51.601517 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.601721 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.601820 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:16:51.605257 3116 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:16:51.608733 3116 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:51.623695 3885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.617337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33119 (local address 127.0.0.1:45636)
0807 02:16:51.617863 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.617937 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.618077 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.619207 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.619213 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.619239 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:51.619381 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.619387 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.620513 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.620520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.621892 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.621903 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.623092 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.623096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.623205 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.623249 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.623374 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.623520 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":79,"thread_start_us":96,"threads_started":1}
I20260807 02:16:51.623699 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.617485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.1.126.194:33119)
0807 02:16:51.618697 (+ 1212us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.618752 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.618777 (+ 25us) server_negotiation.cc:407] Connection header received
0807 02:16:51.618869 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.618873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.619032 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.619204 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:51.619496 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.620402 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.622029 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.622960 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.623077 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.623254 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.623413 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.623513 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1104,"thread_start_us":127,"threads_started":1}
I20260807 02:16:51.623898 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.618105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46751 (local address 127.0.0.1:58202)
0807 02:16:51.618605 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.618629 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.618750 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.619839 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.619842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.619861 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:51.619983 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.619990 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.621490 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.621494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.622554 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.622565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.623519 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.623523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.623604 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.623627 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.623676 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.623746 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":44,"thread_start_us":96,"threads_started":1}
I20260807 02:16:51.624521 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.617527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39959 (local address 127.0.0.1:38138)
0807 02:16:51.618312 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:51.618325 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:51.618414 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:51.619739 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:51.619742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:51.619763 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:51.619860 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.619866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.621315 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.621318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.622609 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:51.622630 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.624064 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.624068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:51.624168 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.624204 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 02:16:51.624273 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 02:16:51.624344 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"mutex_wait_us":3,"thread_start_us":121,"threads_started":1}
I20260807 02:16:51.624934 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.618330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58202 (local address 127.1.126.193:46751)
0807 02:16:51.619441 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.619447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.619467 (+ 20us) server_negotiation.cc:407] Connection header received
0807 02:16:51.619532 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.619536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.619694 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.620165 (+ 471us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:51.620298 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.621375 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.622673 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.623389 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.624506 (+ 1117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.624649 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.624701 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.624794 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1017,"thread_start_us":71,"threads_started":1}
I20260807 02:16:51.625108 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:51.618966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38138 (local address 127.1.126.195:39959)
0807 02:16:51.619287 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:51.619303 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:51.619327 (+ 24us) server_negotiation.cc:407] Connection header received
0807 02:16:51.619401 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:51.619406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:51.619582 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:51.619750 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:51.619983 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.621187 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.622812 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:51.623566 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:51.623683 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:51.624799 (+ 1116us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:51.624853 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 02:16:51.624938 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":130,"threads_started":1}
I20260807 02:16:51.627328 3324 tablet_service.cc:1467] Processing CreateTablet for tablet d8de569d418547799845cdf704901dc9 (DEFAULT_TABLE table=test-table [id=205cd8b4a85042a880e237f89a41ff5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:51.627317 3543 tablet_service.cc:1467] Processing CreateTablet for tablet d8de569d418547799845cdf704901dc9 (DEFAULT_TABLE table=test-table [id=205cd8b4a85042a880e237f89a41ff5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:51.627568 3758 tablet_service.cc:1467] Processing CreateTablet for tablet d8de569d418547799845cdf704901dc9 (DEFAULT_TABLE table=test-table [id=205cd8b4a85042a880e237f89a41ff5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:51.628398 3324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8de569d418547799845cdf704901dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:51.628398 3543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8de569d418547799845cdf704901dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:51.628402 3758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8de569d418547799845cdf704901dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:51.635030 3894 tablet_bootstrap.cc:492] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Bootstrap starting.
I20260807 02:16:51.636483 3896 tablet_bootstrap.cc:492] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Bootstrap starting.
I20260807 02:16:51.636898 3895 tablet_bootstrap.cc:492] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Bootstrap starting.
I20260807 02:16:51.637506 3894 tablet_bootstrap.cc:654] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:51.638427 3894 log.cc:824] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:51.639146 3895 tablet_bootstrap.cc:654] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:51.640023 3895 log.cc:824] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:51.640623 3896 tablet_bootstrap.cc:654] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:51.640645 3894 tablet_bootstrap.cc:492] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: No bootstrap required, opened a new log
I20260807 02:16:51.640861 3894 ts_tablet_manager.cc:1397] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 02:16:51.641366 3896 log.cc:824] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:51.642050 3895 tablet_bootstrap.cc:492] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: No bootstrap required, opened a new log
I20260807 02:16:51.642285 3895 ts_tablet_manager.cc:1397] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:16:51.643074 3896 tablet_bootstrap.cc:492] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: No bootstrap required, opened a new log
I20260807 02:16:51.643273 3896 ts_tablet_manager.cc:1397] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 02:16:51.645630 3894 raft_consensus.cc:348] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:51.645911 3894 raft_consensus.cc:374] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:51.646011 3894 raft_consensus.cc:729] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31296b5d5b7b449db53d28641861ea17, State: Initialized, Role: FOLLOWER
I20260807 02:16:51.646189 3895 raft_consensus.cc:348] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:51.646428 3895 raft_consensus.cc:374] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:51.646522 3895 raft_consensus.cc:729] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32462a556fbc4956bd0a766f2c779b67, State: Initialized, Role: FOLLOWER
I20260807 02:16:51.646502 3894 consensus_queue.cc:260] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:51.646479 3896 raft_consensus.cc:348] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:51.646782 3896 raft_consensus.cc:374] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:51.646888 3896 raft_consensus.cc:729] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccaa0e585d6b4828b1273f35d7a0e606, State: Initialized, Role: FOLLOWER
I20260807 02:16:51.647215 3429 heartbeater.cc:503] Master 127.1.126.254:45485 was elected leader, sending a full tablet report...
I20260807 02:16:51.647342 3896 consensus_queue.cc:260] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:51.647511 3894 ts_tablet_manager.cc:1428] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260807 02:16:51.646988 3895 consensus_queue.cc:260] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:51.647979 3646 heartbeater.cc:503] Master 127.1.126.254:45485 was elected leader, sending a full tablet report...
I20260807 02:16:51.648307 3896 ts_tablet_manager.cc:1428] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260807 02:16:51.648645 3895 ts_tablet_manager.cc:1428] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 02:16:51.649037 3850 heartbeater.cc:503] Master 127.1.126.254:45485 was elected leader, sending a full tablet report...
W20260807 02:16:51.806766 3851 tablet.cc:2369] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:16:51.814658 3648 tablet.cc:2369] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:16:51.833854 3436 tablet.cc:2369] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:16:52.012274 3902 raft_consensus.cc:482] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:52.012604 3902 raft_consensus.cc:504] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:52.014387 3902 leader_election.cc:288] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119), 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751)
I20260807 02:16:52.019565 3693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.014646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33119 (local address 127.1.126.195:45345)
0807 02:16:52.014820 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.014835 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.014934 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.015610 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.015613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.015661 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:52.015789 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.015800 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.016857 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.016860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.018192 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.018207 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.019109 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.019112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.019229 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.019264 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.019350 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.019427 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 02:16:52.019596 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.015152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:45345 (local address 127.1.126.194:33119)
0807 02:16:52.015332 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.015339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.015358 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:16:52.015417 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.015421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.015473 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.015549 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:52.015938 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.016736 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.018353 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.019000 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.019128 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.019224 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.019385 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.019464 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 02:16:52.020432 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.015187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:47561 (local address 127.1.126.193:46751)
0807 02:16:52.015382 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.015390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.015409 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:16:52.015599 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.015605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.015688 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.015773 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:52.016219 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.016940 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.019232 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.019866 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.019967 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.020003 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.020263 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.020343 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 02:16:52.020439 3903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.014743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46751 (local address 127.1.126.195:47561)
0807 02:16:52.015312 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.015327 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.015417 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.015890 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.015893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.015915 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:52.016048 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.016054 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.017052 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.017056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.019094 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.019105 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.020008 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.020016 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.020130 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.020161 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.020221 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.020306 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":146,"threads_started":1}
I20260807 02:16:52.020560 3580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8de569d418547799845cdf704901dc9" candidate_uuid: "32462a556fbc4956bd0a766f2c779b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" is_pre_election: true
I20260807 02:16:52.020874 3580 raft_consensus.cc:2454] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32462a556fbc4956bd0a766f2c779b67 in term 0.
I20260807 02:16:52.021314 3352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8de569d418547799845cdf704901dc9" candidate_uuid: "32462a556fbc4956bd0a766f2c779b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31296b5d5b7b449db53d28641861ea17" is_pre_election: true
I20260807 02:16:52.021405 3684 leader_election.cc:302] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32462a556fbc4956bd0a766f2c779b67, ccaa0e585d6b4828b1273f35d7a0e606; no voters:
I20260807 02:16:52.021636 3352 raft_consensus.cc:2454] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32462a556fbc4956bd0a766f2c779b67 in term 0.
I20260807 02:16:52.021682 3902 raft_consensus.cc:2781] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:52.021771 3902 raft_consensus.cc:482] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:52.021826 3902 raft_consensus.cc:3037] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.023125 3902 raft_consensus.cc:504] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:52.023481 3902 leader_election.cc:288] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [CANDIDATE]: Term 1 election: Requested vote from peers ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119), 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751)
I20260807 02:16:52.023869 3580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8de569d418547799845cdf704901dc9" candidate_uuid: "32462a556fbc4956bd0a766f2c779b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccaa0e585d6b4828b1273f35d7a0e606"
I20260807 02:16:52.023869 3352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8de569d418547799845cdf704901dc9" candidate_uuid: "32462a556fbc4956bd0a766f2c779b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31296b5d5b7b449db53d28641861ea17"
I20260807 02:16:52.023998 3352 raft_consensus.cc:3037] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.023998 3580 raft_consensus.cc:3037] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.025256 3580 raft_consensus.cc:2454] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32462a556fbc4956bd0a766f2c779b67 in term 1.
I20260807 02:16:52.025256 3352 raft_consensus.cc:2454] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32462a556fbc4956bd0a766f2c779b67 in term 1.
I20260807 02:16:52.025594 3684 leader_election.cc:302] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32462a556fbc4956bd0a766f2c779b67, ccaa0e585d6b4828b1273f35d7a0e606; no voters:
I20260807 02:16:52.025760 3902 raft_consensus.cc:2781] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:52.025924 3902 raft_consensus.cc:686] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 1 LEADER]: Becoming Leader. State: Replica: 32462a556fbc4956bd0a766f2c779b67, State: Running, Role: LEADER
I20260807 02:16:52.026242 3902 consensus_queue.cc:237] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } }
I20260807 02:16:52.029357 3113 catalog_manager.cc:5495] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195). New cstate: current_term: 1 leader_uuid: "32462a556fbc4956bd0a766f2c779b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } health_report { overall_health: UNKNOWN } } }
I20260807 02:16:52.088830 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.084484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38146 (local address 127.1.126.195:39959)
0807 02:16:52.084618 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.084623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.084641 (+ 18us) server_negotiation.cc:407] Connection header received
0807 02:16:52.084899 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.084903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.084986 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.085131 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:52.085392 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.086218 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.087176 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.087557 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.087673 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.087971 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.088449 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.088562 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.088633 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.088687 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:16:52.094954 3352 raft_consensus.cc:1261] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Refusing update from remote peer 32462a556fbc4956bd0a766f2c779b67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:52.095706 3902 consensus_queue.cc:1035] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:52.096662 3580 raft_consensus.cc:1261] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Refusing update from remote peer 32462a556fbc4956bd0a766f2c779b67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:52.097285 3902 consensus_queue.cc:1035] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:52.103860 3908 mvcc.cc:205] Tried to move back new op lower bound from 7315738673532596224 to 7315738673262374912. Current Snapshot: MvccSnapshot[applied={T|T < 7315738673532596224}]
I20260807 02:16:52.105055 3912 mvcc.cc:205] Tried to move back new op lower bound from 7315738673532596224 to 7315738673262374912. Current Snapshot: MvccSnapshot[applied={T|T < 7315738673532596224}]
I20260807 02:16:52.118091 3118 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:52.118285 3118 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:52.120957 3118 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: Sending DeleteTablet for 3 replicas of tablet d8de569d418547799845cdf704901dc9
I20260807 02:16:52.121897 3758 tablet_service.cc:1514] Processing DeleteTablet for tablet d8de569d418547799845cdf704901dc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:38138
I20260807 02:16:52.121896 3543 tablet_service.cc:1514] Processing DeleteTablet for tablet d8de569d418547799845cdf704901dc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:45636
I20260807 02:16:52.122385 3919 tablet_replica.cc:330] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: stopping tablet replica
I20260807 02:16:52.122381 3324 tablet_service.cc:1514] Processing DeleteTablet for tablet d8de569d418547799845cdf704901dc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:58202
I20260807 02:16:52.122926 3920 tablet_replica.cc:330] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: stopping tablet replica
I20260807 02:16:52.122918 3919 raft_consensus.cc:2229] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:16:52.123128 3118 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 02:16:52.123224 3920 raft_consensus.cc:2229] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:52.123505 3920 raft_consensus.cc:2258] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 02:16:52.123531 3118 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:52.123562 3919 raft_consensus.cc:2258] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:52.125126 3920 ts_tablet_manager.cc:1905] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:52.125324 3919 ts_tablet_manager.cc:1905] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:52.128106 3919 ts_tablet_manager.cc:1918] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:16:52.128131 3920 ts_tablet_manager.cc:1918] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:16:52.128248 3920 log.cc:1196] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/d8de569d418547799845cdf704901dc9
I20260807 02:16:52.128345 3919 log.cc:1196] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/d8de569d418547799845cdf704901dc9
I20260807 02:16:52.128626 3920 ts_tablet_manager.cc:1939] T d8de569d418547799845cdf704901dc9 P 31296b5d5b7b449db53d28641861ea17: Deleting consensus metadata
I20260807 02:16:52.128793 3919 ts_tablet_manager.cc:1939] T d8de569d418547799845cdf704901dc9 P 32462a556fbc4956bd0a766f2c779b67: Deleting consensus metadata
I20260807 02:16:52.129603 3324 tablet_service.cc:1467] Processing CreateTablet for tablet b167f877c8d24e76aac6860a7609f292 (DEFAULT_TABLE table=test-table [id=8ef1d0797f9744449076043f08cecb3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:52.129895 3324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b167f877c8d24e76aac6860a7609f292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:52.129894 3100 catalog_manager.cc:4841] TS 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751): tablet d8de569d418547799845cdf704901dc9 (table test-table [id=205cd8b4a85042a880e237f89a41ff5b]) successfully deleted
I20260807 02:16:52.130084 3100 catalog_manager.cc:4841] TS 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959): tablet d8de569d418547799845cdf704901dc9 (table test-table [id=205cd8b4a85042a880e237f89a41ff5b]) successfully deleted
I20260807 02:16:52.130995 3758 tablet_service.cc:1467] Processing CreateTablet for tablet b167f877c8d24e76aac6860a7609f292 (DEFAULT_TABLE table=test-table [id=8ef1d0797f9744449076043f08cecb3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:52.131244 3758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b167f877c8d24e76aac6860a7609f292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:52.131887 3894 tablet_bootstrap.cc:492] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Bootstrap starting.
I20260807 02:16:52.132992 3894 tablet_bootstrap.cc:654] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:52.133392 3895 tablet_bootstrap.cc:492] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Bootstrap starting.
I20260807 02:16:52.133673 3543 tablet_service.cc:1467] Processing CreateTablet for tablet b167f877c8d24e76aac6860a7609f292 (DEFAULT_TABLE table=test-table [id=8ef1d0797f9744449076043f08cecb3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:52.133961 3543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b167f877c8d24e76aac6860a7609f292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:52.134330 3895 tablet_bootstrap.cc:654] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:52.135726 3895 tablet_bootstrap.cc:492] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: No bootstrap required, opened a new log
I20260807 02:16:52.135787 3894 tablet_bootstrap.cc:492] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: No bootstrap required, opened a new log
I20260807 02:16:52.135814 3895 ts_tablet_manager.cc:1397] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:52.135852 3894 ts_tablet_manager.cc:1397] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 02:16:52.136292 3896 tablet_bootstrap.cc:492] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Bootstrap starting.
I20260807 02:16:52.136273 3895 raft_consensus.cc:348] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.136265 3894 raft_consensus.cc:348] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.136368 3894 raft_consensus.cc:374] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:52.136368 3895 raft_consensus.cc:374] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:52.136404 3895 raft_consensus.cc:729] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32462a556fbc4956bd0a766f2c779b67, State: Initialized, Role: FOLLOWER
I20260807 02:16:52.136404 3894 raft_consensus.cc:729] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31296b5d5b7b449db53d28641861ea17, State: Initialized, Role: FOLLOWER
I20260807 02:16:52.136521 3894 consensus_queue.cc:260] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.136521 3895 consensus_queue.cc:260] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.136775 3895 ts_tablet_manager.cc:1428] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 02:16:52.136775 3894 ts_tablet_manager.cc:1428] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:52.137192 3896 tablet_bootstrap.cc:654] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:52.138039 3918 tablet_replica.cc:330] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: stopping tablet replica
I20260807 02:16:52.138420 3896 tablet_bootstrap.cc:492] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: No bootstrap required, opened a new log
I20260807 02:16:52.138522 3896 ts_tablet_manager.cc:1397] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 02:16:52.138427 3918 raft_consensus.cc:2229] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:52.139590 3918 raft_consensus.cc:2258] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:52.139667 3896 raft_consensus.cc:348] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.139791 3896 raft_consensus.cc:374] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:52.139832 3896 raft_consensus.cc:729] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccaa0e585d6b4828b1273f35d7a0e606, State: Initialized, Role: FOLLOWER
I20260807 02:16:52.139963 3896 consensus_queue.cc:260] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.140259 3896 ts_tablet_manager.cc:1428] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 02:16:52.141386 3918 ts_tablet_manager.cc:1905] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:52.143754 3918 ts_tablet_manager.cc:1918] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:16:52.143862 3918 log.cc:1196] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/d8de569d418547799845cdf704901dc9
I20260807 02:16:52.144183 3918 ts_tablet_manager.cc:1939] T d8de569d418547799845cdf704901dc9 P ccaa0e585d6b4828b1273f35d7a0e606: Deleting consensus metadata
I20260807 02:16:52.145193 3097 catalog_manager.cc:4841] TS ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119): tablet d8de569d418547799845cdf704901dc9 (table test-table [id=205cd8b4a85042a880e237f89a41ff5b]) successfully deleted
I20260807 02:16:52.162447 3900 raft_consensus.cc:482] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:52.162586 3900 raft_consensus.cc:504] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.164120 3900 leader_election.cc:288] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119), 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959)
I20260807 02:16:52.169106 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.164789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:33743 (local address 127.1.126.195:39959)
0807 02:16:52.164904 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.164908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.164922 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:16:52.164975 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.164978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.165022 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.165108 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:52.165591 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.166086 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.167833 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.168500 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.168639 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.168697 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.168909 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.168984 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:16:52.169134 3924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.164362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39959 (local address 127.1.126.193:33743)
0807 02:16:52.164681 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.164695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.164788 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.165154 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.165157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.165178 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:52.165485 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.165495 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.166211 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.166215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.167692 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.167704 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.168646 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.168649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.168766 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.168788 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.168887 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.168967 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":82,"spinlock_wait_cycles":18176,"thread_start_us":117,"threads_started":1}
I20260807 02:16:52.170075 3787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b167f877c8d24e76aac6860a7609f292" candidate_uuid: "31296b5d5b7b449db53d28641861ea17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32462a556fbc4956bd0a766f2c779b67" is_pre_election: true
I20260807 02:16:52.170338 3787 raft_consensus.cc:2454] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31296b5d5b7b449db53d28641861ea17 in term 0.
I20260807 02:16:52.170403 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.164434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:50875 (local address 127.1.126.194:33119)
0807 02:16:52.164569 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.164573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.164740 (+ 167us) server_negotiation.cc:407] Connection header received
0807 02:16:52.164921 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.164924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.164985 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.165028 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:52.165552 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.166316 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.168762 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.169358 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.169475 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.169533 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.170178 (+ 645us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.170275 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:16:52.170836 3927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.164303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33119 (local address 127.1.126.193:50875)
0807 02:16:52.164638 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.164653 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.164793 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.165185 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.165187 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.165224 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:52.165364 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.165371 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.166434 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.166437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.167696 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.167704 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.169892 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.169898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.170013 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.170041 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.170587 (+ 546us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.170669 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":35,"spinlock_wait_cycles":1536,"thread_start_us":84,"threads_started":1}
I20260807 02:16:52.171111 3253 leader_election.cc:302] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31296b5d5b7b449db53d28641861ea17, 32462a556fbc4956bd0a766f2c779b67; no voters:
I20260807 02:16:52.171351 3580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b167f877c8d24e76aac6860a7609f292" candidate_uuid: "31296b5d5b7b449db53d28641861ea17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" is_pre_election: true
I20260807 02:16:52.171422 3900 raft_consensus.cc:2781] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:52.171483 3580 raft_consensus.cc:2454] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31296b5d5b7b449db53d28641861ea17 in term 0.
I20260807 02:16:52.171494 3900 raft_consensus.cc:482] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:52.171541 3900 raft_consensus.cc:3037] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.172837 3900 raft_consensus.cc:504] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.173218 3900 leader_election.cc:288] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [CANDIDATE]: Term 1 election: Requested vote from peers ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119), 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959)
I20260807 02:16:52.173552 3580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b167f877c8d24e76aac6860a7609f292" candidate_uuid: "31296b5d5b7b449db53d28641861ea17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccaa0e585d6b4828b1273f35d7a0e606"
I20260807 02:16:52.173681 3580 raft_consensus.cc:3037] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.173681 3787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b167f877c8d24e76aac6860a7609f292" candidate_uuid: "31296b5d5b7b449db53d28641861ea17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32462a556fbc4956bd0a766f2c779b67"
I20260807 02:16:52.173804 3787 raft_consensus.cc:3037] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.174957 3580 raft_consensus.cc:2454] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31296b5d5b7b449db53d28641861ea17 in term 1.
I20260807 02:16:52.175127 3787 raft_consensus.cc:2454] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31296b5d5b7b449db53d28641861ea17 in term 1.
I20260807 02:16:52.175328 3247 leader_election.cc:302] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31296b5d5b7b449db53d28641861ea17, ccaa0e585d6b4828b1273f35d7a0e606; no voters:
I20260807 02:16:52.175495 3900 raft_consensus.cc:2781] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:52.175717 3900 raft_consensus.cc:686] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 1 LEADER]: Becoming Leader. State: Replica: 31296b5d5b7b449db53d28641861ea17, State: Running, Role: LEADER
I20260807 02:16:52.175969 3900 consensus_queue.cc:237] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.178485 3116 catalog_manager.cc:5495] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31296b5d5b7b449db53d28641861ea17 (127.1.126.193). New cstate: current_term: 1 leader_uuid: "31296b5d5b7b449db53d28641861ea17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } health_report { overall_health: UNKNOWN } } }
Aug 07 02:16:52 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069010, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:52.222190 3936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.212560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45485 (local address 127.0.0.1:53700)
0807 02:16:52.212894 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.212913 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.213018 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.213330 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.213333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.213709 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:52.213820 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.213826 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.214937 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.214940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.215491 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.215498 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.216046 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.216048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.216109 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.216714 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:52.216733 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:52.218368 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:52.220347 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:52.220358 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:52.220364 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:52.220687 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:52.220984 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:52.220987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:52.220989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:52.221112 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:52.221570 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:52.221577 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:52.221700 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.221823 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.221998 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":145,"threads_started":1}
I20260807 02:16:52.222256 3937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.212658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53700 (local address 127.1.126.254:45485)
0807 02:16:52.212956 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.212970 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.212989 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:16:52.213123 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.213128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.213185 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.213297 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:52.213956 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.214835 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.215615 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.215919 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.216023 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.218511 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:52.218514 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:52.218517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:52.218538 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:52.220201 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:52.220782 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:52.220785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:52.220786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:52.220858 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:52.221216 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:52.221229 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:52.221230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:52.221413 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:52.221546 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.221876 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.222096 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":229,"thread_start_us":131,"threads_started":1}
I20260807 02:16:52.226267 3116 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:53700:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 02:16:52.227074 3116 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:52.232589 3543 tablet_service.cc:1467] Processing CreateTablet for tablet 747d0e071c7c42f29379db273db53114 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb4117bcd0b94c2cafe3e25cb216490d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:16:52.232589 3324 tablet_service.cc:1467] Processing CreateTablet for tablet 747d0e071c7c42f29379db273db53114 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb4117bcd0b94c2cafe3e25cb216490d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:16:52.233011 3543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 747d0e071c7c42f29379db273db53114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:52.233014 3324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 747d0e071c7c42f29379db273db53114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:52.233009 3758 tablet_service.cc:1467] Processing CreateTablet for tablet 747d0e071c7c42f29379db273db53114 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb4117bcd0b94c2cafe3e25cb216490d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:16:52.233439 3758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 747d0e071c7c42f29379db273db53114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:52.236121 3894 tablet_bootstrap.cc:492] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: Bootstrap starting.
I20260807 02:16:52.236930 3895 tablet_bootstrap.cc:492] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: Bootstrap starting.
I20260807 02:16:52.237285 3894 tablet_bootstrap.cc:654] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:52.238008 3895 tablet_bootstrap.cc:654] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:52.238986 3894 tablet_bootstrap.cc:492] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: No bootstrap required, opened a new log
I20260807 02:16:52.239073 3894 ts_tablet_manager.cc:1397] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 02:16:52.239570 3894 raft_consensus.cc:348] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.239699 3894 raft_consensus.cc:374] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:52.239750 3894 raft_consensus.cc:729] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31296b5d5b7b449db53d28641861ea17, State: Initialized, Role: FOLLOWER
I20260807 02:16:52.239779 3895 tablet_bootstrap.cc:492] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: No bootstrap required, opened a new log
I20260807 02:16:52.239858 3895 ts_tablet_manager.cc:1397] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:16:52.239890 3894 consensus_queue.cc:260] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.240177 3894 ts_tablet_manager.cc:1428] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 02:16:52.240190 3900 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.240366 3900 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.240902 3896 tablet_bootstrap.cc:492] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: Bootstrap starting.
I20260807 02:16:52.240887 3895 raft_consensus.cc:348] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.240993 3895 raft_consensus.cc:374] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:52.241024 3895 raft_consensus.cc:729] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32462a556fbc4956bd0a766f2c779b67, State: Initialized, Role: FOLLOWER
I20260807 02:16:52.241134 3895 consensus_queue.cc:260] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.241365 3904 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.241501 3904 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.241962 3896 tablet_bootstrap.cc:654] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:52.242074 3895 ts_tablet_manager.cc:1428] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 02:16:52.244556 3896 tablet_bootstrap.cc:492] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: No bootstrap required, opened a new log
I20260807 02:16:52.244653 3896 ts_tablet_manager.cc:1397] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 02:16:52.245126 3896 raft_consensus.cc:348] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.245246 3896 raft_consensus.cc:374] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:52.245285 3896 raft_consensus.cc:729] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccaa0e585d6b4828b1273f35d7a0e606, State: Initialized, Role: FOLLOWER
I20260807 02:16:52.245415 3896 consensus_queue.cc:260] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.245668 3896 ts_tablet_manager.cc:1428] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 02:16:52.245878 3901 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.246016 3901 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.286566 3901 raft_consensus.cc:482] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:52.286693 3901 raft_consensus.cc:504] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.288065 3901 leader_election.cc:288] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751), 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959)
I20260807 02:16:52.293361 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.288849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:45147 (local address 127.1.126.195:39959)
0807 02:16:52.288971 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.288976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.289164 (+ 188us) server_negotiation.cc:407] Connection header received
0807 02:16:52.289372 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.289376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.289422 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.289473 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:52.289850 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.290574 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.292270 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.292682 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.292826 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.292896 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.293138 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.293211 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:16:52.293437 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.288413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:48617 (local address 127.1.126.193:46751)
0807 02:16:52.288552 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.288556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.288687 (+ 131us) server_negotiation.cc:407] Connection header received
0807 02:16:52.288943 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.288949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.289005 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.289061 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:52.289531 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.290325 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.292219 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.292767 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.292935 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.293040 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.293228 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.293301 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:16:52.293443 3946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.288712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39959 (local address 127.1.126.194:45147)
0807 02:16:52.289077 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.289090 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.289245 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.289608 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.289611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.289625 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:52.289723 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.289728 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.290751 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.290754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.292049 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.292061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.292827 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.292830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.293003 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.293040 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.293110 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.293181 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":77,"thread_start_us":102,"threads_started":1}
I20260807 02:16:52.293457 3945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.288291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46751 (local address 127.1.126.194:48617)
0807 02:16:52.288593 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.288611 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.288790 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.289245 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.289249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.289263 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:52.289405 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.289412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.290457 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.290460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.292053 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.292061 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.292932 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.292936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.293084 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.293107 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.293210 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.293282 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":46,"thread_start_us":130,"threads_started":1}
I20260807 02:16:52.293851 3787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747d0e071c7c42f29379db273db53114" candidate_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32462a556fbc4956bd0a766f2c779b67" is_pre_election: true
I20260807 02:16:52.294013 3787 raft_consensus.cc:2454] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccaa0e585d6b4828b1273f35d7a0e606 in term 0.
I20260807 02:16:52.294044 3352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747d0e071c7c42f29379db273db53114" candidate_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31296b5d5b7b449db53d28641861ea17" is_pre_election: true
I20260807 02:16:52.294175 3352 raft_consensus.cc:2454] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccaa0e585d6b4828b1273f35d7a0e606 in term 0.
I20260807 02:16:52.294462 3482 leader_election.cc:302] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32462a556fbc4956bd0a766f2c779b67, ccaa0e585d6b4828b1273f35d7a0e606; no voters:
I20260807 02:16:52.294765 3901 raft_consensus.cc:2781] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:52.294828 3901 raft_consensus.cc:482] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:52.294857 3901 raft_consensus.cc:3037] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.295840 3901 raft_consensus.cc:504] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.296167 3901 leader_election.cc:288] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [CANDIDATE]: Term 1 election: Requested vote from peers 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751), 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959)
I20260807 02:16:52.296569 3352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747d0e071c7c42f29379db273db53114" candidate_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31296b5d5b7b449db53d28641861ea17"
I20260807 02:16:52.296617 3787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747d0e071c7c42f29379db273db53114" candidate_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32462a556fbc4956bd0a766f2c779b67"
I20260807 02:16:52.296692 3352 raft_consensus.cc:3037] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.296715 3787 raft_consensus.cc:3037] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:52.297771 3352 raft_consensus.cc:2454] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccaa0e585d6b4828b1273f35d7a0e606 in term 1.
I20260807 02:16:52.297771 3787 raft_consensus.cc:2454] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccaa0e585d6b4828b1273f35d7a0e606 in term 1.
I20260807 02:16:52.298071 3482 leader_election.cc:302] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31296b5d5b7b449db53d28641861ea17, ccaa0e585d6b4828b1273f35d7a0e606; no voters:
I20260807 02:16:52.298266 3901 raft_consensus.cc:2781] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:52.298518 3901 raft_consensus.cc:686] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 LEADER]: Becoming Leader. State: Replica: ccaa0e585d6b4828b1273f35d7a0e606, State: Running, Role: LEADER
I20260807 02:16:52.298780 3901 consensus_queue.cc:237] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } }
I20260807 02:16:52.300047 3947 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: TxnStatusTablet state changed. Reason: New leader ccaa0e585d6b4828b1273f35d7a0e606. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.300170 3947 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:16:52.300491 3950 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 02:16:52.300644 3950 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 02:16:52.301170 3113 catalog_manager.cc:5495] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194). New cstate: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } health_report { overall_health: UNKNOWN } } }
I20260807 02:16:52.327060 3936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.323437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33119 (local address 127.0.0.1:45640)
0807 02:16:52.323587 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.323604 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.323721 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.324058 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.324061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.324068 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:52.324181 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.324187 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.324895 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.324899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.325471 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.325479 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.325950 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.325953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.326052 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.326095 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.326759 (+ 664us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.326778 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.326865 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.326946 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 02:16:52.327060 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.323660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45640 (local address 127.1.126.194:33119)
0807 02:16:52.323783 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.323803 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.323818 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:16:52.323890 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.323893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.323939 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.324037 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:52.324296 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.324778 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.325594 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.325828 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.325946 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.326246 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.326626 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.326761 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.326879 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.326929 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:16:52.330052 3352 raft_consensus.cc:1261] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Refusing update from remote peer ccaa0e585d6b4828b1273f35d7a0e606: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:52.330181 3787 raft_consensus.cc:1261] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Refusing update from remote peer ccaa0e585d6b4828b1273f35d7a0e606: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:52.330670 3901 consensus_queue.cc:1035] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:52.330883 3947 consensus_queue.cc:1035] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:52.332371 3900 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: TxnStatusTablet state changed. Reason: New leader ccaa0e585d6b4828b1273f35d7a0e606. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.332476 3900 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.334203 3904 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: TxnStatusTablet state changed. Reason: New leader ccaa0e585d6b4828b1273f35d7a0e606. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.334316 3904 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.337270 3901 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.337383 3901 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:16:52.337502 3901 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.337572 3901 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P ccaa0e585d6b4828b1273f35d7a0e606: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:16:52.338249 3904 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.338366 3904 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P 32462a556fbc4956bd0a766f2c779b67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.338881 3907 mvcc.cc:205] Tried to move back new op lower bound from 7315738674498674688 to 7315738674377961472. Current Snapshot: MvccSnapshot[applied={T|T < 7315738674498674688 or (T in {7315738674498674688})}]
I20260807 02:16:52.339664 3900 tablet_replica.cc:439] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31296b5d5b7b449db53d28641861ea17" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46751 } } peers { permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 } } peers { permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 } } }
I20260807 02:16:52.339779 3900 tablet_replica.cc:442] T 747d0e071c7c42f29379db273db53114 P 31296b5d5b7b449db53d28641861ea17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:52.345839 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.342104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58214 (local address 127.1.126.193:46751)
0807 02:16:52.342222 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.342231 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.342244 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:16:52.342399 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.342402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.342455 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.342539 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:52.342813 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.343296 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.344474 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.344684 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.344764 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.345045 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.345447 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.345534 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.345639 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.345687 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 02:16:52.357693 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.354325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:35635 (local address 127.1.126.194:33119)
0807 02:16:52.354538 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.354546 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.354630 (+ 84us) server_negotiation.cc:407] Connection header received
0807 02:16:52.354813 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.354816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.354866 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.354948 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:52.355213 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.355768 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.356626 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.356850 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.356960 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.357260 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.357333 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.357411 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.357504 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.357551 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260807 02:16:52.357722 3964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.354195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33119 (local address 127.1.126.193:35635)
0807 02:16:52.354507 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.354523 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.354678 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.354964 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.354967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.354975 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:52.355097 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.355102 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.355880 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.355884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.356485 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.356494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.356965 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.356968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.357077 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.357120 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.357423 (+ 303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.357431 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.357495 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.357568 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":126,"threads_started":1}
I20260807 02:16:52.365052 3787 raft_consensus.cc:1261] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Refusing update from remote peer 31296b5d5b7b449db53d28641861ea17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:52.365123 3580 raft_consensus.cc:1261] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Refusing update from remote peer 31296b5d5b7b449db53d28641861ea17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:52.365527 3900 consensus_queue.cc:1035] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32462a556fbc4956bd0a766f2c779b67" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:52.365712 3928 consensus_queue.cc:1035] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccaa0e585d6b4828b1273f35d7a0e606" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:52.389624 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.385663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46751 (local address 127.1.126.194:52429)
0807 02:16:52.385975 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:52.385988 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:52.386076 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:52.386316 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:52.386318 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:52.386356 (+ 38us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:52.386530 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.386537 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.387532 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.387631 (+ 99us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.388325 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:52.388336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.388840 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.388843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:52.388931 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.388974 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.389306 (+ 332us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.389315 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 02:16:52.389398 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:16:52.389478 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":108,"threads_started":1}
I20260807 02:16:52.389608 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.385706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:52429 (local address 127.1.126.193:46751)
0807 02:16:52.385848 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.385853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.386057 (+ 204us) server_negotiation.cc:407] Connection header received
0807 02:16:52.386174 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.386177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.386228 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.386314 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:52.386660 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.387373 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.388445 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.388700 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.388828 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.389133 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:52.389217 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:52.389298 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.389422 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.389470 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:16:52.418660 3116 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:52.418916 3116 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:52.421227 3116 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 623719d7e04346558336273816a2f7bc: Sending DeleteTablet for 3 replicas of tablet b167f877c8d24e76aac6860a7609f292
I20260807 02:16:52.422046 3324 tablet_service.cc:1514] Processing DeleteTablet for tablet b167f877c8d24e76aac6860a7609f292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:58202
I20260807 02:16:52.422245 3920 tablet_replica.cc:330] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: stopping tablet replica
I20260807 02:16:52.422202 3758 tablet_service.cc:1514] Processing DeleteTablet for tablet b167f877c8d24e76aac6860a7609f292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:38138
I20260807 02:16:52.422355 3920 raft_consensus.cc:2229] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:16:52.422420 3919 tablet_replica.cc:330] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: stopping tablet replica
I20260807 02:16:52.422537 3919 raft_consensus.cc:2229] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:52.422664 3919 raft_consensus.cc:2258] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:52.422657 3920 raft_consensus.cc:2258] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:52.422691 3543 tablet_service.cc:1514] Processing DeleteTablet for tablet b167f877c8d24e76aac6860a7609f292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:45636
I20260807 02:16:52.423079 3918 tablet_replica.cc:330] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: stopping tablet replica
I20260807 02:16:52.423190 3918 raft_consensus.cc:2229] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:52.423300 3918 raft_consensus.cc:2258] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:52.423661 3919 ts_tablet_manager.cc:1905] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:52.423967 3920 ts_tablet_manager.cc:1905] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:52.426621 3919 ts_tablet_manager.cc:1918] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:52.426693 3919 log.cc:1196] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/b167f877c8d24e76aac6860a7609f292
I20260807 02:16:52.426919 3920 ts_tablet_manager.cc:1918] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:52.426992 3920 log.cc:1196] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/b167f877c8d24e76aac6860a7609f292
I20260807 02:16:52.426990 3919 ts_tablet_manager.cc:1939] T b167f877c8d24e76aac6860a7609f292 P 32462a556fbc4956bd0a766f2c779b67: Deleting consensus metadata
I20260807 02:16:52.427253 3920 ts_tablet_manager.cc:1939] T b167f877c8d24e76aac6860a7609f292 P 31296b5d5b7b449db53d28641861ea17: Deleting consensus metadata
I20260807 02:16:52.427700 3100 catalog_manager.cc:4841] TS 32462a556fbc4956bd0a766f2c779b67 (127.1.126.195:39959): tablet b167f877c8d24e76aac6860a7609f292 (table test-table [id=8ef1d0797f9744449076043f08cecb3c]) successfully deleted
I20260807 02:16:52.427872 3100 catalog_manager.cc:4841] TS 31296b5d5b7b449db53d28641861ea17 (127.1.126.193:46751): tablet b167f877c8d24e76aac6860a7609f292 (table test-table [id=8ef1d0797f9744449076043f08cecb3c]) successfully deleted
I20260807 02:16:52.428690 3918 ts_tablet_manager.cc:1905] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:52.431387 3918 ts_tablet_manager.cc:1918] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:52.431475 3918 log.cc:1196] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/b167f877c8d24e76aac6860a7609f292
I20260807 02:16:52.431757 3918 ts_tablet_manager.cc:1939] T b167f877c8d24e76aac6860a7609f292 P ccaa0e585d6b4828b1273f35d7a0e606: Deleting consensus metadata
I20260807 02:16:52.432574 3097 catalog_manager.cc:4841] TS ccaa0e585d6b4828b1273f35d7a0e606 (127.1.126.194:33119): tablet b167f877c8d24e76aac6860a7609f292 (table test-table [id=8ef1d0797f9744449076043f08cecb3c]) successfully deleted
Aug 07 02:16:52 dist-test-slave-39l8 krb5kdc[3055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:16:52.444489 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.431102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58228 (local address 127.1.126.193:46751)
0807 02:16:52.431225 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.431230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.431938 (+ 708us) server_negotiation.cc:407] Connection header received
0807 02:16:52.432212 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.432216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.432263 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.432313 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:52.433748 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.434593 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.435887 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.436228 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.436341 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.440274 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:52.440285 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:52.440303 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:52.440330 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:52.442417 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:52.442984 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:52.442991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:52.442993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:52.443098 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:52.443435 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:52.443438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:52.443439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:52.443731 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:52.443924 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.444196 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.444317 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 02:16:52.445127 3416 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58228
I20260807 02:16:52.456209 3937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:52.446999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53706 (local address 127.1.126.254:45485)
0807 02:16:52.447122 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:52.447133 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:52.447224 (+ 91us) server_negotiation.cc:407] Connection header received
0807 02:16:52.447397 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:52.447400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:52.447448 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:52.447497 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:52.448357 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.449180 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.450335 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:52.450679 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:52.450781 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:52.452460 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:52.452464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:52.452467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:52.452494 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:52.454236 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:52.454785 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:52.454789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:52.454791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:52.454881 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:52.455210 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:52.455213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:52.455215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:52.455439 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:52.455540 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:52.455881 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 02:16:52.456027 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 02:16:52.457276 3116 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53706
I20260807 02:16:52.459018 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 3224
I20260807 02:16:52.475749 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 3445
I20260807 02:16:52.487824 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 3659
I20260807 02:16:52.498937 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 3075
2026-08-07T02:16:52Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3337 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:16:52 dist-test-slave-39l8 krb5kdc[3985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:16:52 dist-test-slave-39l8 krb5kdc[3985](info): set up 2 sockets
Aug 07 02:16:52 dist-test-slave-39l8 krb5kdc[3985](info): commencing operation
krb5kdc: starting...
W20260807 02:16:53.687417 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:16:53 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:16:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:16:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:16:53.813309 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38623
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:38623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:53.923961 4000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:53.924245 4000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:53.924345 4000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:53.928392 4000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:16:53.928470 4000 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 02:16:53.928501 4000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:53.928565 4000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:53.928604 4000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:16:53.928642 4000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:16:53.933904 4000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:38623
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:53.934980 4000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:53.936009 4000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:53.944309 4007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:53.944482 4011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:53.944408 4000 server_base.cc:1034] running on GCE node
W20260807 02:16:53.944307 4008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:53.945093 4000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:53.946152 4000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:53.947338 4000 hybrid_clock.cc:648] HybridClock initialized: now 1786069013947325 us; error 35 us; skew 500 ppm
Aug 07 02:16:53 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069013, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:53.950068 4000 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:16:53.950980 4000 webserver.cc:460] Webserver started at http://127.1.126.254:35215/ using document root <none> and password file <none>
I20260807 02:16:53.951532 4000 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:53.951632 4000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:53.951862 4000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:53.953866 4000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2"
format_stamp: "Formatted at 2026-08-07 02:16:53 on dist-test-slave-39l8"
server_key: "20c6194a5e2cb9e495a018870ed63642"
server_key_iv: "7cb38d5d1b36701ad8603e1958a85bac"
server_key_version: "encryptionkey@0"
I20260807 02:16:53.954456 4000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2"
format_stamp: "Formatted at 2026-08-07 02:16:53 on dist-test-slave-39l8"
server_key: "20c6194a5e2cb9e495a018870ed63642"
server_key_iv: "7cb38d5d1b36701ad8603e1958a85bac"
server_key_version: "encryptionkey@0"
I20260807 02:16:53.958050 4000 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:16:53.960484 4025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:53.961567 4000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 02:16:53.961711 4000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2"
format_stamp: "Formatted at 2026-08-07 02:16:53 on dist-test-slave-39l8"
server_key: "20c6194a5e2cb9e495a018870ed63642"
server_key_iv: "7cb38d5d1b36701ad8603e1958a85bac"
server_key_version: "encryptionkey@0"
I20260807 02:16:53.961819 4000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:53.985853 4000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:53.988682 4000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:53.988900 4000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:53.997182 4000 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:38623
I20260807 02:16:53.997201 4111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:38623 every 8 connection(s)
I20260807 02:16:53.998095 4000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:16:53.999533 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 4000
I20260807 02:16:53.999658 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:16:53.999920 1531 external_mini_cluster.cc:1428] Setting key 0aec3360740693cebf8a32ad24fc1c68
I20260807 02:16:54.001318 4112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:54.008272 4112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Bootstrap starting.
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:54.010841 4112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:54.012328 4112 log.cc:824] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:54.015398 4112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: No bootstrap required, opened a new log
I20260807 02:16:54.016254 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.001403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39104 (local address 127.1.126.254:38623)
0807 02:16:54.001848 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.001866 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.001904 (+ 38us) server_negotiation.cc:407] Connection header received
0807 02:16:54.002760 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.002785 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.003201 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.003537 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.004206 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.005740 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.006553 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.007262 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.007426 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.009991 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.009997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.010012 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.010043 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.012222 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.012811 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.012817 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.012823 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.012951 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.013293 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.013300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.013305 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.013856 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.014109 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.014572 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.015028 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":108,"threads_started":1}
I20260807 02:16:54.019758 4112 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38623 } }
I20260807 02:16:54.020085 4112 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:54.020154 4112 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f8ca6eb6ff418696e8e5b3bbed9da2, State: Initialized, Role: FOLLOWER
I20260807 02:16:54.020677 4112 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38623 } }
I20260807 02:16:54.020849 4112 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:16:54.020910 4112 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:16:54.021003 4112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:54.022140 4112 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38623 } }
I20260807 02:16:54.022428 4112 leader_election.cc:302] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8f8ca6eb6ff418696e8e5b3bbed9da2; no voters:
I20260807 02:16:54.022735 4112 leader_election.cc:288] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:16:54.022864 4118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:54.023116 4118 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [term 1 LEADER]: Becoming Leader. State: Replica: f8f8ca6eb6ff418696e8e5b3bbed9da2, State: Running, Role: LEADER
I20260807 02:16:54.023416 4118 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38623 } }
I20260807 02:16:54.023926 4112 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:16:54.024967 4121 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8f8ca6eb6ff418696e8e5b3bbed9da2. Latest consensus state: current_term: 1 leader_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38623 } } }
I20260807 02:16:54.025090 4121 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:54.025429 4131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:16:54.026575 4120 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f8ca6eb6ff418696e8e5b3bbed9da2" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38623 } } }
I20260807 02:16:54.026734 4120 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2 [sys.catalog]: This master's current role is: LEADER
I20260807 02:16:54.028622 4131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:16:54.033598 4131 catalog_manager.cc:1347] Generated new cluster ID: bf67817712bb4fdba7ab0c61658c39dc
I20260807 02:16:54.033659 4131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:16:54.053874 4131 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:16:54.055130 4131 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:16:54.060290 4131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Generated new TSK 0
I20260807 02:16:54.060922 4131 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:16:54.106918 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38623
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:54.229127 4154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:54.229369 4154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:54.229415 4154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:54.233354 4154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:54.233410 4154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:54.233450 4154 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 02:16:54.233464 4154 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:16:54.233495 4154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:16:54.238725 4154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:38623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:54.239743 4154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:54.240721 4154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:54.250681 4167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:54.250676 4164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:54.250681 4162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:54.250762 4154 server_base.cc:1034] running on GCE node
I20260807 02:16:54.251281 4154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:54.251965 4154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:54.253156 4154 hybrid_clock.cc:648] HybridClock initialized: now 1786069014253137 us; error 37 us; skew 500 ppm
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:54.255936 4154 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:16:54.256800 4154 webserver.cc:460] Webserver started at http://127.1.126.193:40311/ using document root <none> and password file <none>
I20260807 02:16:54.257365 4154 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:54.257455 4154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:54.257709 4154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:54.259799 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "f10adf7e46fe4a63b969a0168e7cc4dc"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "01e80f2ee83425f8bc1046e4f9c48de2"
server_key_iv: "8bdf91071b38b8dae92b2fc5cd02c364"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.260355 4154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "f10adf7e46fe4a63b969a0168e7cc4dc"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "01e80f2ee83425f8bc1046e4f9c48de2"
server_key_iv: "8bdf91071b38b8dae92b2fc5cd02c364"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.264283 4154 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 02:16:54.266896 4176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:54.268169 4154 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:16:54.268323 4154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "f10adf7e46fe4a63b969a0168e7cc4dc"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "01e80f2ee83425f8bc1046e4f9c48de2"
server_key_iv: "8bdf91071b38b8dae92b2fc5cd02c364"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.268455 4154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:54.295553 4154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:54.299211 4154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:54.299422 4154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:54.300897 4154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:54.300971 4154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:54.301038 4154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:54.301085 4154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:54.311980 4154 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:40081
I20260807 02:16:54.312165 4343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:40081 every 8 connection(s)
I20260807 02:16:54.313067 4154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:16:54.315099 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 4154
I20260807 02:16:54.315243 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:16:54.315588 1531 external_mini_cluster.cc:1428] Setting key 2bc22504c21e0fd2963a6cced3eea7c8
I20260807 02:16:54.316368 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.301753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:45249 (local address 127.1.126.254:38623)
0807 02:16:54.301932 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.301937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.303183 (+ 1246us) server_negotiation.cc:407] Connection header received
0807 02:16:54.304319 (+ 1136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.304323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.304383 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.304496 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.306181 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.307094 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.308994 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.309233 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.309317 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.312484 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.312488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.312491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.312522 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.314033 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.314521 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.314526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.314527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.314606 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.315047 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.315050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.315051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.315328 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.315429 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.316050 (+ 621us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.316221 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 02:16:54.317286 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.302517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.1.126.193:45249)
0807 02:16:54.302985 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.303051 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.304096 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.304703 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.304710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.305250 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:54.305987 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.306008 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.307278 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.307284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.308866 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.308877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.309399 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.309405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.309620 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.310294 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:54.310323 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:54.312303 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:54.314150 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.314156 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.314169 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.314414 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.314727 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.314733 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.314735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.314938 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.315457 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:54.315465 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:54.315761 (+ 296us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.315960 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.316294 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":149,"threads_started":1}
I20260807 02:16:54.318738 4344 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38623
I20260807 02:16:54.318924 4344 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:54.319569 4344 heartbeater.cc:511] Master 127.1.126.254:38623 requested a full tablet report, sending...
I20260807 02:16:54.321358 4047 ts_manager.cc:194] Registered new tserver with Master: f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081)
I20260807 02:16:54.322796 4047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:45249
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:16:54.329564 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.321146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.1.126.193:38783)
0807 02:16:54.321448 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.321465 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.321551 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.321789 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.321791 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.322017 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:54.322141 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.322148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.323491 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.323497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.324591 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.324606 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.325180 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.325186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.325339 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.325815 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:54.325834 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:54.326308 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:54.328088 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.328094 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.328099 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.328300 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.328576 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.328579 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.328581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.328749 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.329132 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:54.329153 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:54.329240 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.329323 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.329432 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":106,"threads_started":1}
I20260807 02:16:54.329591 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.321486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38783 (local address 127.1.126.254:38623)
0807 02:16:54.321599 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.321602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.321612 (+ 10us) server_negotiation.cc:407] Connection header received
0807 02:16:54.321643 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.321646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.321678 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.321746 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.322276 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.323208 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.324725 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.325038 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.325133 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.326450 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.326453 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.326455 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.326477 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.327979 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.328388 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.328391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.328392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.328462 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.328852 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.328858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.328862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.329038 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.329127 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.329386 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.329480 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:16:54.345355 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38623
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:54.458489 4358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:54.458851 4358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:54.458968 4358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:54.463194 4358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:54.463254 4358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:54.463322 4358 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 02:16:54.463351 4358 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:16:54.463435 4358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:16:54.469280 4358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:38623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:54.470273 4358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:54.471369 4358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:54.481143 4369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:54.481150 4372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:54.481206 4358 server_base.cc:1034] running on GCE node
W20260807 02:16:54.481150 4366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:54.481820 4358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:54.482384 4358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:54.483582 4358 hybrid_clock.cc:648] HybridClock initialized: now 1786069014483564 us; error 28 us; skew 500 ppm
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:54.486255 4358 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:16:54.487226 4358 webserver.cc:460] Webserver started at http://127.1.126.194:45649/ using document root <none> and password file <none>
I20260807 02:16:54.487794 4358 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:54.487896 4358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:54.488107 4358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:54.490053 4358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "6992f29906964a8ca48f150804a62b0f"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "bb9dbc759f4e74d369fe814ef9f3b76e"
server_key_iv: "a9f86c9e6e66d3fde06b0ac315089150"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.490623 4358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "6992f29906964a8ca48f150804a62b0f"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "bb9dbc759f4e74d369fe814ef9f3b76e"
server_key_iv: "a9f86c9e6e66d3fde06b0ac315089150"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.494505 4358 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 02:16:54.496884 4382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:54.498071 4358 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:54.498208 4358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "6992f29906964a8ca48f150804a62b0f"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "bb9dbc759f4e74d369fe814ef9f3b76e"
server_key_iv: "a9f86c9e6e66d3fde06b0ac315089150"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.498314 4358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:54.516865 4358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:54.520139 4358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:54.520335 4358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:54.521852 4358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:54.521924 4358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:54.521996 4358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:54.522063 4358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:54.535792 4358 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:39709
I20260807 02:16:54.535977 4544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:39709 every 8 connection(s)
I20260807 02:16:54.536864 4358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:16:54.540608 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.522892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:49859 (local address 127.1.126.254:38623)
0807 02:16:54.523023 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.523029 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.524116 (+ 1087us) server_negotiation.cc:407] Connection header received
0807 02:16:54.525384 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.525387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.525449 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.525553 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.527407 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.528107 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.529521 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.530143 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.530254 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.533725 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.533731 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.533734 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.533776 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.535631 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.536356 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.536362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.536367 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.536475 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.537019 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.537024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.537026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.537332 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.537446 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.540195 (+ 2749us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.540379 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:16:54.539987 4392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.523394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.1.126.194:49859)
0807 02:16:54.523865 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.523974 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.525102 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.525746 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.525758 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.526271 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:54.527260 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.527287 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.528266 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.528269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.529393 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.529403 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.530316 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.530320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.530555 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.531361 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:54.531381 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:54.533491 (+ 2110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:54.535772 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.535780 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.535797 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.536209 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.536629 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.536635 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.536640 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.536883 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.537513 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:54.537536 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:54.537942 (+ 406us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.538177 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.538610 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":137,"threads_started":1}
I20260807 02:16:54.542191 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 4358
I20260807 02:16:54.542315 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:16:54.542436 4545 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38623
I20260807 02:16:54.542608 4545 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:54.542662 1531 external_mini_cluster.cc:1428] Setting key 91b7965fb5645ef943d4ab64d3d99d44
I20260807 02:16:54.543182 4545 heartbeater.cc:511] Master 127.1.126.254:38623 requested a full tablet report, sending...
I20260807 02:16:54.544309 4050 ts_manager.cc:194] Registered new tserver with Master: 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:54.544885 4050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:49859
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:16:54.553915 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.546906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58039 (local address 127.1.126.254:38623)
0807 02:16:54.547023 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.547027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.547140 (+ 113us) server_negotiation.cc:407] Connection header received
0807 02:16:54.547272 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.547275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.547316 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.547408 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.547839 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.548339 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.549202 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.549414 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.549469 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.550657 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.550661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.550663 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.550687 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.552230 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.552682 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.552685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.552687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.552771 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.553053 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.553057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.553059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.553281 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.553398 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.553657 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.553781 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:16:54.553925 4557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.546780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.1.126.194:58039)
0807 02:16:54.547071 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.547085 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.547185 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.547426 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.547429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.547630 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:54.547725 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.547730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.548457 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.548460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.549033 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.549047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.549594 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.549596 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.549665 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.550192 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:54.550203 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:54.550522 (+ 319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:54.552357 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.552362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.552365 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.552568 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.552865 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.552869 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.552871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.552959 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.553385 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:54.553388 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:54.553489 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.553599 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.553740 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:16:54.571820 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38623
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:16:54.684108 4559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:16:54.684378 4559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:16:54.684456 4559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:16:54.688473 4559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:16:54.688552 4559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:16:54.688625 4559 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 02:16:54.688668 4559 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:16:54.688728 4559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:16:54.693905 4559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:38623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:16:54.694957 4559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:16:54.695940 4559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:16:54.705559 4568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:54.705600 4566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:16:54.705678 4564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:16:54.705726 4559 server_base.cc:1034] running on GCE node
I20260807 02:16:54.706200 4559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:16:54.706820 4559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:16:54.707975 4559 hybrid_clock.cc:648] HybridClock initialized: now 1786069014707957 us; error 30 us; skew 500 ppm
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:16:54.710652 4559 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:16:54.711477 4559 webserver.cc:460] Webserver started at http://127.1.126.195:35157/ using document root <none> and password file <none>
I20260807 02:16:54.712026 4559 fs_manager.cc:359] Metadata directory not provided
I20260807 02:16:54.712116 4559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:16:54.712342 4559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:16:54.714248 4559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "8efca91956534cfdab26d01e45e0e308"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "bb0763efd40a6c1c3b98f315d99de0ad"
server_key_iv: "048ea70044499e552293839037d093c7"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.714854 4559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "8efca91956534cfdab26d01e45e0e308"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "bb0763efd40a6c1c3b98f315d99de0ad"
server_key_iv: "048ea70044499e552293839037d093c7"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.718282 4559 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:16:54.720728 4575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:54.721879 4559 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:54.722012 4559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "8efca91956534cfdab26d01e45e0e308"
format_stamp: "Formatted at 2026-08-07 02:16:54 on dist-test-slave-39l8"
server_key: "bb0763efd40a6c1c3b98f315d99de0ad"
server_key_iv: "048ea70044499e552293839037d093c7"
server_key_version: "encryptionkey@0"
I20260807 02:16:54.722126 4559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:16:54.732728 4559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:16:54.735386 4559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:16:54.735567 4559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:16:54.736965 4559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:16:54.737038 4559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:16:54.737105 4559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:16:54.737154 4559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:54.748009 4559 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:43593
I20260807 02:16:54.748091 4735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:43593 every 8 connection(s)
I20260807 02:16:54.749087 4559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:16:54.751858 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.737778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:58231 (local address 127.1.126.254:38623)
0807 02:16:54.737913 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.737918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.738761 (+ 843us) server_negotiation.cc:407] Connection header received
0807 02:16:54.739691 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.739695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.739754 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.739842 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.741511 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.742444 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.744051 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.744292 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.744408 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.748112 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.748116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.748119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.748148 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.749723 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.750303 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.750307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.750309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.750409 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.750814 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.750817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.750818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.751000 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.751109 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.751571 (+ 462us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.751690 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:16:54.752593 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.738127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.1.126.195:58231)
0807 02:16:54.738580 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.738639 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.739455 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.740161 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.740171 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.740684 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:54.741317 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.741342 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.742594 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.742597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.743936 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.743948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.744464 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.744469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.744650 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.745970 (+ 1320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:54.745995 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:54.747938 (+ 1943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:54.749843 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.749850 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.749864 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.750191 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.750505 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.750509 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.750511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.750673 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.751109 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:54.751117 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:54.751341 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.751512 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.751816 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":139,"threads_started":1}
I20260807 02:16:54.753669 4738 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38623
I20260807 02:16:54.753823 4738 heartbeater.cc:464] Registering TS with master...
I20260807 02:16:54.754354 4738 heartbeater.cc:511] Master 127.1.126.254:38623 requested a full tablet report, sending...
I20260807 02:16:54.755499 4047 ts_manager.cc:194] Registered new tserver with Master: 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593)
I20260807 02:16:54.756219 4047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:58231
I20260807 02:16:54.758306 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 4559
I20260807 02:16:54.758428 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:16:54.758765 1531 external_mini_cluster.cc:1428] Setting key 912d49c5fe20463611b2d93ff3b7ca87
I20260807 02:16:54.761191 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:16:54.763574 4746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.755997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.1.126.195:46549)
0807 02:16:54.756273 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.756291 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.756428 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.756708 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.756712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.756914 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:54.757024 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.757030 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.757970 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.757972 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.758815 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.758838 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.759254 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.759259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.759357 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.759875 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:54.759887 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:54.760260 (+ 373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:54.762068 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.762071 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.762072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.762267 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.762619 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:54.762622 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:54.762624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:54.762745 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:54.763186 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:54.763188 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:54.763262 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.763344 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.763442 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":7,"thread_start_us":98,"threads_started":1}
I20260807 02:16:54.763952 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.756062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:46549 (local address 127.1.126.254:38623)
0807 02:16:54.756201 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.756206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.756363 (+ 157us) server_negotiation.cc:407] Connection header received
0807 02:16:54.756548 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.756552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.756599 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.756677 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.757140 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.757845 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.758937 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.759125 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.759223 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.760384 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.760387 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.760390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.760413 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.761939 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.762364 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.762370 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.762374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.762482 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.762838 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.762844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.762848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.763085 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.763193 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.763426 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.763555 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 02:16:54 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:54.788259 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.780943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39110 (local address 127.1.126.254:38623)
0807 02:16:54.781064 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.781067 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.781079 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:16:54.781118 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.781120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.781155 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.781224 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:54.781887 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.782362 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.783198 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.783384 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.783454 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.785593 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:54.785595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:54.785597 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:54.785618 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:54.786837 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.787214 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.787216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.787218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.787287 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:54.787517 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:54.787520 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:54.787521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:54.787683 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:54.787782 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.787981 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.788068 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:16:54.791188 4047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:16:54.794142 4047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:54.808588 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.802823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56662 (local address 127.1.126.193:40081)
0807 02:16:54.803515 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.803533 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.803557 (+ 24us) server_negotiation.cc:407] Connection header received
0807 02:16:54.803634 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.803639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.803831 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.804340 (+ 509us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:54.804495 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.805631 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.806989 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.807653 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.808023 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.808176 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.808301 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.808402 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":87,"threads_started":1}
I20260807 02:16:54.808602 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.802360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:43593 (local address 127.0.0.1:51986)
0807 02:16:54.802980 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.803025 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.803149 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.803963 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.803971 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.803998 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:54.804141 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.804146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.805343 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.805349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.806799 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.806811 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.807780 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.807783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.808015 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.808140 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.808256 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.808420 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":150,"spinlock_wait_cycles":1280,"thread_start_us":87,"threads_started":1}
I20260807 02:16:54.808601 4760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.802545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40081 (local address 127.0.0.1:56662)
0807 02:16:54.803163 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.803179 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.803266 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.803995 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.803999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.804016 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:54.804189 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.804197 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.805755 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.805758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.806862 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.806872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.807792 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.807796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.807983 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.808138 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.808256 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.808420 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":89,"thread_start_us":105,"threads_started":1}
I20260807 02:16:54.809165 4765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.803460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39709 (local address 127.0.0.1:51746)
0807 02:16:54.804015 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:54.804028 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:54.804097 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:54.804789 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:54.804792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:54.804810 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:54.804909 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.804915 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.806075 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.806078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.807270 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:54.807282 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.808553 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.808557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:54.808872 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.808899 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:16:54.808971 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 02:16:54.809041 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":89,"threads_started":1}
I20260807 02:16:54.809290 4759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.802507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51986 (local address 127.1.126.195:43593)
0807 02:16:54.803469 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.803482 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.803508 (+ 26us) server_negotiation.cc:407] Connection header received
0807 02:16:54.803588 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.803593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.803791 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.804272 (+ 481us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:54.804392 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.805243 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.806911 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.807650 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.807778 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.807935 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.809030 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.809122 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":859,"thread_start_us":103,"threads_started":1}
I20260807 02:16:54.809628 4766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:54.803639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51746 (local address 127.1.126.194:39709)
0807 02:16:54.804332 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:54.804343 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:54.804364 (+ 21us) server_negotiation.cc:407] Connection header received
0807 02:16:54.804450 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:54.804454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:54.804642 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:54.804795 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:54.805027 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.805962 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.807420 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:54.808252 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:54.808361 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:54.808488 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:54.809398 (+ 910us) server_negotiation.cc:299] Negotiation successful
0807 02:16:54.809495 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":118,"threads_started":1}
I20260807 02:16:54.811663 4242 tablet_service.cc:1467] Processing CreateTablet for tablet f8cbace6ef504b75a28abf1caa9e5706 (DEFAULT_TABLE table=test-table [id=8f828ba072d94401a3dc3f479a063e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:54.811872 4644 tablet_service.cc:1467] Processing CreateTablet for tablet f8cbace6ef504b75a28abf1caa9e5706 (DEFAULT_TABLE table=test-table [id=8f828ba072d94401a3dc3f479a063e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:54.811872 4447 tablet_service.cc:1467] Processing CreateTablet for tablet f8cbace6ef504b75a28abf1caa9e5706 (DEFAULT_TABLE table=test-table [id=8f828ba072d94401a3dc3f479a063e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:54.812589 4242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8cbace6ef504b75a28abf1caa9e5706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:54.812867 4447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8cbace6ef504b75a28abf1caa9e5706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:54.812867 4644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8cbace6ef504b75a28abf1caa9e5706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:54.819800 4769 tablet_bootstrap.cc:492] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Bootstrap starting.
I20260807 02:16:54.820902 4771 tablet_bootstrap.cc:492] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Bootstrap starting.
I20260807 02:16:54.821977 4769 tablet_bootstrap.cc:654] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:54.822639 4771 tablet_bootstrap.cc:654] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:54.822805 4769 log.cc:824] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:54.823444 4773 tablet_bootstrap.cc:492] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Bootstrap starting.
I20260807 02:16:54.823544 4771 log.cc:824] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:54.824998 4769 tablet_bootstrap.cc:492] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: No bootstrap required, opened a new log
I20260807 02:16:54.825201 4769 ts_tablet_manager.cc:1397] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:16:54.825515 4771 tablet_bootstrap.cc:492] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: No bootstrap required, opened a new log
I20260807 02:16:54.825711 4771 ts_tablet_manager.cc:1397] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:16:54.826284 4773 tablet_bootstrap.cc:654] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:54.827092 4773 log.cc:824] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Log is configured to *not* fsync() on all Append() calls
I20260807 02:16:54.828653 4773 tablet_bootstrap.cc:492] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: No bootstrap required, opened a new log
I20260807 02:16:54.828858 4773 ts_tablet_manager.cc:1397] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:16:54.829128 4769 raft_consensus.cc:348] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:54.829412 4769 raft_consensus.cc:374] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:54.829478 4769 raft_consensus.cc:729] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Initialized, Role: FOLLOWER
I20260807 02:16:54.829348 4771 raft_consensus.cc:348] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:54.829584 4771 raft_consensus.cc:374] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:54.829643 4771 raft_consensus.cc:729] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6992f29906964a8ca48f150804a62b0f, State: Initialized, Role: FOLLOWER
I20260807 02:16:54.829941 4769 consensus_queue.cc:260] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:54.830184 4771 consensus_queue.cc:260] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:54.830655 4344 heartbeater.cc:503] Master 127.1.126.254:38623 was elected leader, sending a full tablet report...
I20260807 02:16:54.830963 4769 ts_tablet_manager.cc:1428] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:16:54.830997 4771 ts_tablet_manager.cc:1428] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:16:54.831288 4545 heartbeater.cc:503] Master 127.1.126.254:38623 was elected leader, sending a full tablet report...
I20260807 02:16:54.833576 4773 raft_consensus.cc:348] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:54.833811 4773 raft_consensus.cc:374] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:54.833873 4773 raft_consensus.cc:729] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Initialized, Role: FOLLOWER
I20260807 02:16:54.834306 4773 consensus_queue.cc:260] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:54.835770 4738 heartbeater.cc:503] Master 127.1.126.254:38623 was elected leader, sending a full tablet report...
I20260807 02:16:54.835928 4773 ts_tablet_manager.cc:1428] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260807 02:16:55.000094 4739 tablet.cc:2369] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:16:55.029587 4777 raft_consensus.cc:482] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:55.029815 4777 raft_consensus.cc:504] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:55.030977 4777 leader_election.cc:288] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:55.034966 4779 raft_consensus.cc:482] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:55.035131 4779 raft_consensus.cc:504] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:55.035400 4766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.031812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38209 (local address 127.1.126.194:39709)
0807 02:16:55.031976 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.031981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.032119 (+ 138us) server_negotiation.cc:407] Connection header received
0807 02:16:55.032221 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.032227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.032314 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.032398 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:55.032652 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.033292 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.034371 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.034820 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.034943 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.034996 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.035208 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.035287 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:16:55.035409 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.031683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39709 (local address 127.1.126.193:38209)
0807 02:16:55.032019 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.032034 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.032129 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.032407 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.032410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.032426 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:55.032537 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.032542 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.033390 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.033395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.034232 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.034242 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.034943 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.034947 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.035041 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.035063 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.035170 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.035250 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":22,"thread_start_us":120,"threads_started":1}
I20260807 02:16:55.035496 4759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.031341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:33171 (local address 127.1.126.195:43593)
0807 02:16:55.031475 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.031479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.031752 (+ 273us) server_negotiation.cc:407] Connection header received
0807 02:16:55.031817 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.031820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.031877 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.031974 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:55.032328 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.032995 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.034384 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.034858 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.034977 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.035030 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.035307 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.035378 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:16:55.035877 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.031266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:43593 (local address 127.1.126.193:33171)
0807 02:16:55.031550 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.031568 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.031694 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.031999 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.032004 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.032046 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:55.032186 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.032195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.033237 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.033240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.034248 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.034258 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.035060 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.035063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.035172 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.035193 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.035657 (+ 464us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.035730 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":54,"thread_start_us":95,"threads_started":1}
I20260807 02:16:55.035971 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8cbace6ef504b75a28abf1caa9e5706" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f" is_pre_election: true
I20260807 02:16:55.036259 4455 raft_consensus.cc:2454] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 0.
I20260807 02:16:55.036373 4779 leader_election.cc:288] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:55.036806 4178 leader_election.cc:302] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:55.037343 4777 raft_consensus.cc:2781] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:55.037374 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8cbace6ef504b75a28abf1caa9e5706" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efca91956534cfdab26d01e45e0e308" is_pre_election: true
I20260807 02:16:55.037441 4777 raft_consensus.cc:482] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:55.037501 4777 raft_consensus.cc:3037] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.037554 4669 raft_consensus.cc:2454] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 0.
I20260807 02:16:55.038916 4777 raft_consensus.cc:504] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:55.039239 4777 leader_election.cc:288] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 election: Requested vote from peers 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:55.039635 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8cbace6ef504b75a28abf1caa9e5706" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f"
I20260807 02:16:55.039762 4455 raft_consensus.cc:3037] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.039778 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8cbace6ef504b75a28abf1caa9e5706" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efca91956534cfdab26d01e45e0e308"
I20260807 02:16:55.039876 4669 raft_consensus.cc:3037] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.040910 4766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.036846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:60371 (local address 127.1.126.194:39709)
0807 02:16:55.037066 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.037069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.037080 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:16:55.037122 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.037124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.037152 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.037235 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:55.037515 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.038153 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.039684 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.040258 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.040346 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.040393 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.040726 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.040792 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260807 02:16:55.041090 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.036447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40081 (local address 127.1.126.195:40269)
0807 02:16:55.036542 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.036555 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.036634 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.037326 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.037328 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.037347 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:55.037836 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.037851 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.038610 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.038622 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.039679 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.039689 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.040609 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.040624 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.040758 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.040782 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.040853 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.040925 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 02:16:55.041090 4455 raft_consensus.cc:2454] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 1.
I20260807 02:16:55.041131 4669 raft_consensus.cc:2454] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 1.
I20260807 02:16:55.041276 4784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.036572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39709 (local address 127.1.126.195:60371)
0807 02:16:55.036862 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.036876 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.036961 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.037250 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.037253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.037271 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:16:55.037380 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.037386 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.038307 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.038310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.039540 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.039553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.040496 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.040499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.040593 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.040613 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.041020 (+ 407us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.041108 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":97,"threads_started":1}
W20260807 02:16:55.041426 4546 tablet.cc:2369] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:16:55.041692 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.036947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:40269 (local address 127.1.126.193:40081)
0807 02:16:55.037049 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.037056 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.037073 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:16:55.037111 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.037122 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.037161 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.037234 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:16:55.037965 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.038499 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.039829 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.040381 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.040508 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.040549 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.041512 (+ 963us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.041580 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 02:16:55.042218 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8cbace6ef504b75a28abf1caa9e5706" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f" is_pre_election: true
I20260807 02:16:55.042397 4455 raft_consensus.cc:2379] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8efca91956534cfdab26d01e45e0e308 in current term 1: Already voted for candidate f10adf7e46fe4a63b969a0168e7cc4dc in this term.
I20260807 02:16:55.042397 4178 leader_election.cc:302] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:55.042457 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8cbace6ef504b75a28abf1caa9e5706" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" is_pre_election: true
I20260807 02:16:55.042677 4274 raft_consensus.cc:2379] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8efca91956534cfdab26d01e45e0e308 in current term 1: Already voted for candidate f10adf7e46fe4a63b969a0168e7cc4dc in this term.
I20260807 02:16:55.042892 4777 raft_consensus.cc:2781] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:55.043102 4777 raft_consensus.cc:686] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 LEADER]: Becoming Leader. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Running, Role: LEADER
I20260807 02:16:55.043213 4580 leader_election.cc:302] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8efca91956534cfdab26d01e45e0e308; no voters: 6992f29906964a8ca48f150804a62b0f, f10adf7e46fe4a63b969a0168e7cc4dc
I20260807 02:16:55.043399 4777 consensus_queue.cc:237] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } }
I20260807 02:16:55.043486 4779 raft_consensus.cc:2726] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 02:16:55.046000 4050 catalog_manager.cc:5495] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193). New cstate: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } health_report { overall_health: UNKNOWN } } }
W20260807 02:16:55.064585 4345 tablet.cc:2369] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 02:16:55 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069013, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:55.121618 4794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.112449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38623 (local address 127.0.0.1:39114)
0807 02:16:55.112757 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.112769 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.112910 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.113184 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.113187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.113600 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:16:55.113698 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.113704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.114447 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.114453 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.115026 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.115034 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.115475 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.115478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.115570 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.116165 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:16:55.116183 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:16:55.117708 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:16:55.119915 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:55.119924 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:55.119931 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:55.120220 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:55.120555 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:16:55.120559 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:16:55.120578 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:16:55.120677 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:16:55.121138 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:16:55.121143 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:16:55.121258 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.121352 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.121459 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":110,"threads_started":1}
I20260807 02:16:55.121645 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.112493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39114 (local address 127.1.126.254:38623)
0807 02:16:55.112654 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.112659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.112850 (+ 191us) server_negotiation.cc:407] Connection header received
0807 02:16:55.113018 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.113021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.113067 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.113150 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:55.113820 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.114340 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.115156 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.115366 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.115473 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.117856 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:55.117859 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:55.117861 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:55.117892 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:55.119797 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:55.120345 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:55.120349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:55.120350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:55.120457 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:55.120780 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:55.120784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:55.120786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:55.121038 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:55.121135 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.121416 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.121521 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:16:55.125739 4050 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:39114:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 02:16:55.126506 4050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:55.131323 4242 tablet_service.cc:1467] Processing CreateTablet for tablet 9026ae1708714793a6fcf213f5be00af (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e84f5fdfc5754109958703d9e6553d2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:16:55.131418 4644 tablet_service.cc:1467] Processing CreateTablet for tablet 9026ae1708714793a6fcf213f5be00af (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e84f5fdfc5754109958703d9e6553d2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:16:55.131361 4447 tablet_service.cc:1467] Processing CreateTablet for tablet 9026ae1708714793a6fcf213f5be00af (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e84f5fdfc5754109958703d9e6553d2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:16:55.132068 4447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9026ae1708714793a6fcf213f5be00af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:55.132079 4644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9026ae1708714793a6fcf213f5be00af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:55.132079 4242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9026ae1708714793a6fcf213f5be00af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:55.134685 4771 tablet_bootstrap.cc:492] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: Bootstrap starting.
I20260807 02:16:55.134909 4769 tablet_bootstrap.cc:492] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: Bootstrap starting.
I20260807 02:16:55.135255 4773 tablet_bootstrap.cc:492] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: Bootstrap starting.
I20260807 02:16:55.135775 4771 tablet_bootstrap.cc:654] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:55.136128 4773 tablet_bootstrap.cc:654] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:55.136296 4769 tablet_bootstrap.cc:654] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:55.137537 4769 tablet_bootstrap.cc:492] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: No bootstrap required, opened a new log
I20260807 02:16:55.137531 4771 tablet_bootstrap.cc:492] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: No bootstrap required, opened a new log
I20260807 02:16:55.137636 4773 tablet_bootstrap.cc:492] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: No bootstrap required, opened a new log
I20260807 02:16:55.137642 4769 ts_tablet_manager.cc:1397] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:16:55.137662 4771 ts_tablet_manager.cc:1397] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 02:16:55.137750 4773 ts_tablet_manager.cc:1397] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:16:55.138072 4769 raft_consensus.cc:348] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.138115 4771 raft_consensus.cc:348] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.138187 4769 raft_consensus.cc:374] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:55.138154 4773 raft_consensus.cc:348] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.138222 4769 raft_consensus.cc:729] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Initialized, Role: FOLLOWER
I20260807 02:16:55.138228 4771 raft_consensus.cc:374] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:55.138239 4773 raft_consensus.cc:374] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:55.138264 4771 raft_consensus.cc:729] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6992f29906964a8ca48f150804a62b0f, State: Initialized, Role: FOLLOWER
I20260807 02:16:55.138270 4773 raft_consensus.cc:729] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Initialized, Role: FOLLOWER
I20260807 02:16:55.138365 4769 consensus_queue.cc:260] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.138382 4771 consensus_queue.cc:260] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.138382 4773 consensus_queue.cc:260] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.138617 4773 ts_tablet_manager.cc:1428] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:55.138598 4777 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.138615 4778 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.138736 4777 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.138761 4778 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.138911 4779 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.139031 4779 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.138630 4771 ts_tablet_manager.cc:1428] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 02:16:55.139461 4769 ts_tablet_manager.cc:1428] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 02:16:55.361138 4777 raft_consensus.cc:482] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:55.361287 4777 raft_consensus.cc:504] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.361781 4777 leader_election.cc:288] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709), 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593)
I20260807 02:16:55.362365 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9026ae1708714793a6fcf213f5be00af" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f" is_pre_election: true
I20260807 02:16:55.362397 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9026ae1708714793a6fcf213f5be00af" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efca91956534cfdab26d01e45e0e308" is_pre_election: true
I20260807 02:16:55.362531 4669 raft_consensus.cc:2454] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 0.
I20260807 02:16:55.362531 4455 raft_consensus.cc:2454] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 0.
I20260807 02:16:55.362834 4178 leader_election.cc:302] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:55.363031 4777 raft_consensus.cc:2781] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:55.363098 4777 raft_consensus.cc:482] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:55.363125 4777 raft_consensus.cc:3037] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.364108 4777 raft_consensus.cc:504] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.364427 4777 leader_election.cc:288] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 election: Requested vote from peers 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709), 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593)
I20260807 02:16:55.364853 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9026ae1708714793a6fcf213f5be00af" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f"
I20260807 02:16:55.364924 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9026ae1708714793a6fcf213f5be00af" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efca91956534cfdab26d01e45e0e308"
I20260807 02:16:55.364986 4455 raft_consensus.cc:3037] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.365056 4669 raft_consensus.cc:3037] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.366170 4669 raft_consensus.cc:2454] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 1.
I20260807 02:16:55.366441 4178 leader_election.cc:302] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8efca91956534cfdab26d01e45e0e308, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:55.366542 4455 raft_consensus.cc:2454] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 1.
I20260807 02:16:55.366631 4777 raft_consensus.cc:2781] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:55.366763 4777 raft_consensus.cc:686] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 LEADER]: Becoming Leader. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Running, Role: LEADER
I20260807 02:16:55.366899 4777 consensus_queue.cc:237] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.367640 4785 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: TxnStatusTablet state changed. Reason: New leader f10adf7e46fe4a63b969a0168e7cc4dc. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.367748 4785 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:16:55.368062 4800 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 02:16:55.368320 4800 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 02:16:55.368570 4047 catalog_manager.cc:5495] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193). New cstate: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } health_report { overall_health: UNKNOWN } } }
I20260807 02:16:55.430473 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.426658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56674 (local address 127.1.126.193:40081)
0807 02:16:55.426820 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.426826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.426899 (+ 73us) server_negotiation.cc:407] Connection header received
0807 02:16:55.427140 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.427143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.427202 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.427312 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:55.427584 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.428096 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.428978 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.429207 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.429345 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.429652 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.430065 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.430200 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.430276 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.430330 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 02:16:55.430473 4794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.426555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40081 (local address 127.0.0.1:56674)
0807 02:16:55.426837 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.426854 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.426971 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.427330 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.427333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.427341 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:55.427457 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.427463 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.428216 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.428220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.428851 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.428861 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.429335 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.429339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.429430 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.429487 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.430175 (+ 688us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.430193 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.430267 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.430354 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175}
I20260807 02:16:55.435632 4455 raft_consensus.cc:1261] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Refusing update from remote peer f10adf7e46fe4a63b969a0168e7cc4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:55.435708 4669 raft_consensus.cc:1261] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Refusing update from remote peer f10adf7e46fe4a63b969a0168e7cc4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:55.436342 4785 consensus_queue.cc:1035] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:55.436599 4777 consensus_queue.cc:1035] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:55.441476 4779 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: TxnStatusTablet state changed. Reason: New leader f10adf7e46fe4a63b969a0168e7cc4dc. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.441609 4779 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.442473 4778 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: TxnStatusTablet state changed. Reason: New leader f10adf7e46fe4a63b969a0168e7cc4dc. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.442590 4778 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.444844 4803 mvcc.cc:205] Tried to move back new op lower bound from 7315738687217405952 to 7315738686944333824. Current Snapshot: MvccSnapshot[applied={T|T < 7315738687217405952}]
I20260807 02:16:55.445034 4777 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.445143 4777 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:16:55.445834 4785 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.445926 4785 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P f10adf7e46fe4a63b969a0168e7cc4dc: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:16:55.446162 4805 mvcc.cc:205] Tried to move back new op lower bound from 7315738687217405952 to 7315738686944333824. Current Snapshot: MvccSnapshot[applied={T|T < 7315738687217405952}]
I20260807 02:16:55.446801 4778 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.446904 4778 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P 6992f29906964a8ca48f150804a62b0f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.449869 4779 tablet_replica.cc:439] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } } }
I20260807 02:16:55.449981 4779 tablet_replica.cc:442] T 9026ae1708714793a6fcf213f5be00af P 8efca91956534cfdab26d01e45e0e308: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:16:55.456537 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.452740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56690 (local address 127.1.126.193:40081)
0807 02:16:55.452863 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.452868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.453130 (+ 262us) server_negotiation.cc:407] Connection header received
0807 02:16:55.453298 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.453300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.453338 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.453399 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:55.453721 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.454234 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.455501 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.455720 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.455799 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.456097 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.456174 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.456228 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.456363 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.456403 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 02:16:55.467732 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.464100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:58725 (local address 127.1.126.193:40081)
0807 02:16:55.464226 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.464230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.464414 (+ 184us) server_negotiation.cc:407] Connection header received
0807 02:16:55.464549 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.464551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.464590 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.464648 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:55.464887 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.465476 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.466670 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.466909 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.466987 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.467346 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.467402 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.467453 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.467575 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.467616 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 02:16:55.467876 4821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.463986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40081 (local address 127.1.126.193:58725)
0807 02:16:55.464323 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.464338 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.464446 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.464663 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.464666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.464674 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:55.464779 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.464785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.465587 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.465591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.466547 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.466561 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.467042 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.467046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.467136 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.467201 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.467483 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.467490 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.467559 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.467638 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":1,"thread_start_us":131,"threads_started":1}
I20260807 02:16:55.475173 4669 raft_consensus.cc:1261] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Refusing update from remote peer f10adf7e46fe4a63b969a0168e7cc4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:55.475173 4455 raft_consensus.cc:1261] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Refusing update from remote peer f10adf7e46fe4a63b969a0168e7cc4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:55.475576 4823 consensus_queue.cc:1035] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:55.475725 4777 consensus_queue.cc:1035] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:55.482004 4804 mvcc.cc:205] Tried to move back new op lower bound from 7315738687382380544 to 7315738685620183040. Current Snapshot: MvccSnapshot[applied={T|T < 7315738687382380544}]
I20260807 02:16:55.520184 4047 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:55.520360 4047 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:55.522902 4047 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Sending DeleteTablet for 3 replicas of tablet f8cbace6ef504b75a28abf1caa9e5706
I20260807 02:16:55.523764 4447 tablet_service.cc:1514] Processing DeleteTablet for tablet f8cbace6ef504b75a28abf1caa9e5706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:55 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51746
I20260807 02:16:55.523802 4644 tablet_service.cc:1514] Processing DeleteTablet for tablet f8cbace6ef504b75a28abf1caa9e5706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:55 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260807 02:16:55.524075 4242 tablet_service.cc:1514] Processing DeleteTablet for tablet f8cbace6ef504b75a28abf1caa9e5706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:55 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:56662
I20260807 02:16:55.524585 4831 tablet_replica.cc:330] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: stopping tablet replica
I20260807 02:16:55.524695 4830 tablet_replica.cc:330] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: stopping tablet replica
I20260807 02:16:55.524667 4047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 02:16:55.525015 4829 tablet_replica.cc:330] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: stopping tablet replica
W20260807 02:16:55.525120 4047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:55.525285 4831 raft_consensus.cc:2229] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:16:55.525472 4830 raft_consensus.cc:2229] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:55.525702 4830 raft_consensus.cc:2258] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:55.525823 4831 raft_consensus.cc:2258] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:55.526046 4829 raft_consensus.cc:2229] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:55.526237 4829 raft_consensus.cc:2258] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:55.527535 4829 ts_tablet_manager.cc:1905] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:55.527544 4830 ts_tablet_manager.cc:1905] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:55.530489 4829 ts_tablet_manager.cc:1918] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:55.530642 4829 log.cc:1196] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/f8cbace6ef504b75a28abf1caa9e5706
I20260807 02:16:55.530665 4830 ts_tablet_manager.cc:1918] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:55.530686 4447 tablet_service.cc:1467] Processing CreateTablet for tablet 3639012fbb79411aa5dbdbf61ed74ff6 (DEFAULT_TABLE table=test-table [id=383b0ab4eaca472b88c552f2f4ac7757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:55.530788 4830 log.cc:1196] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/f8cbace6ef504b75a28abf1caa9e5706
I20260807 02:16:55.530956 4447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3639012fbb79411aa5dbdbf61ed74ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:55.531101 4830 ts_tablet_manager.cc:1939] T f8cbace6ef504b75a28abf1caa9e5706 P 6992f29906964a8ca48f150804a62b0f: Deleting consensus metadata
I20260807 02:16:55.531317 4829 ts_tablet_manager.cc:1939] T f8cbace6ef504b75a28abf1caa9e5706 P 8efca91956534cfdab26d01e45e0e308: Deleting consensus metadata
I20260807 02:16:55.532389 4026 catalog_manager.cc:4841] TS 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709): tablet f8cbace6ef504b75a28abf1caa9e5706 (table test-table [id=8f828ba072d94401a3dc3f479a063e82]) successfully deleted
I20260807 02:16:55.532584 4026 catalog_manager.cc:4841] TS 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593): tablet f8cbace6ef504b75a28abf1caa9e5706 (table test-table [id=8f828ba072d94401a3dc3f479a063e82]) successfully deleted
I20260807 02:16:55.532995 4644 tablet_service.cc:1467] Processing CreateTablet for tablet 3639012fbb79411aa5dbdbf61ed74ff6 (DEFAULT_TABLE table=test-table [id=383b0ab4eaca472b88c552f2f4ac7757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:55.533258 4644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3639012fbb79411aa5dbdbf61ed74ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:55.533280 4771 tablet_bootstrap.cc:492] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Bootstrap starting.
I20260807 02:16:55.534194 4771 tablet_bootstrap.cc:654] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:55.535447 4771 tablet_bootstrap.cc:492] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: No bootstrap required, opened a new log
I20260807 02:16:55.535535 4771 ts_tablet_manager.cc:1397] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 02:16:55.535537 4773 tablet_bootstrap.cc:492] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Bootstrap starting.
I20260807 02:16:55.535826 4242 tablet_service.cc:1467] Processing CreateTablet for tablet 3639012fbb79411aa5dbdbf61ed74ff6 (DEFAULT_TABLE table=test-table [id=383b0ab4eaca472b88c552f2f4ac7757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:55.536072 4242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3639012fbb79411aa5dbdbf61ed74ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:55.536374 4773 tablet_bootstrap.cc:654] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:55.536504 4771 raft_consensus.cc:348] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.536613 4771 raft_consensus.cc:374] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:55.536643 4771 raft_consensus.cc:729] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6992f29906964a8ca48f150804a62b0f, State: Initialized, Role: FOLLOWER
I20260807 02:16:55.536755 4771 consensus_queue.cc:260] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.536978 4771 ts_tablet_manager.cc:1428] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:55.537758 4773 tablet_bootstrap.cc:492] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: No bootstrap required, opened a new log
I20260807 02:16:55.537829 4773 ts_tablet_manager.cc:1397] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 02:16:55.538280 4773 raft_consensus.cc:348] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.538398 4773 raft_consensus.cc:374] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:55.538434 4773 raft_consensus.cc:729] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Initialized, Role: FOLLOWER
I20260807 02:16:55.538470 4769 tablet_bootstrap.cc:492] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Bootstrap starting.
I20260807 02:16:55.538558 4773 consensus_queue.cc:260] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.539197 4769 tablet_bootstrap.cc:654] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:55.539901 4831 ts_tablet_manager.cc:1905] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:55.540694 4769 tablet_bootstrap.cc:492] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: No bootstrap required, opened a new log
I20260807 02:16:55.540767 4769 ts_tablet_manager.cc:1397] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:55.540934 4773 ts_tablet_manager.cc:1428] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260807 02:16:55.541132 4769 raft_consensus.cc:348] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.541231 4769 raft_consensus.cc:374] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:55.541260 4769 raft_consensus.cc:729] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Initialized, Role: FOLLOWER
I20260807 02:16:55.541255 4779 raft_consensus.cc:482] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:55.541332 4779 raft_consensus.cc:504] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.541368 4769 consensus_queue.cc:260] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.541594 4769 ts_tablet_manager.cc:1428] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:55.541703 4779 leader_election.cc:288] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:55.542265 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3639012fbb79411aa5dbdbf61ed74ff6" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f" is_pre_election: true
I20260807 02:16:55.542398 4455 raft_consensus.cc:2454] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 0.
I20260807 02:16:55.542392 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3639012fbb79411aa5dbdbf61ed74ff6" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" is_pre_election: true
I20260807 02:16:55.542508 4274 raft_consensus.cc:2454] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 0.
I20260807 02:16:55.542762 4576 leader_election.cc:302] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, 8efca91956534cfdab26d01e45e0e308; no voters:
I20260807 02:16:55.542975 4779 raft_consensus.cc:2781] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:55.543027 4779 raft_consensus.cc:482] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:55.543063 4779 raft_consensus.cc:3037] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.544021 4779 raft_consensus.cc:504] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.544087 4831 ts_tablet_manager.cc:1918] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:55.544175 4831 log.cc:1196] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/f8cbace6ef504b75a28abf1caa9e5706
I20260807 02:16:55.544327 4779 leader_election.cc:288] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 election: Requested vote from peers f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:55.544498 4831 ts_tablet_manager.cc:1939] T f8cbace6ef504b75a28abf1caa9e5706 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting consensus metadata
I20260807 02:16:55.544939 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3639012fbb79411aa5dbdbf61ed74ff6" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc"
I20260807 02:16:55.545045 4274 raft_consensus.cc:3037] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.545986 4274 raft_consensus.cc:2454] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 1.
I20260807 02:16:55.546262 4030 catalog_manager.cc:4841] TS f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081): tablet f8cbace6ef504b75a28abf1caa9e5706 (table test-table [id=8f828ba072d94401a3dc3f479a063e82]) successfully deleted
I20260807 02:16:55.546339 4580 leader_election.cc:302] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8efca91956534cfdab26d01e45e0e308, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:55.546510 4779 raft_consensus.cc:2781] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:55.546701 4779 raft_consensus.cc:686] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 1 LEADER]: Becoming Leader. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Running, Role: LEADER
I20260807 02:16:55.546954 4779 consensus_queue.cc:237] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:55.547139 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3639012fbb79411aa5dbdbf61ed74ff6" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f"
I20260807 02:16:55.547250 4455 raft_consensus.cc:3037] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:55.548303 4455 raft_consensus.cc:2454] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 1.
I20260807 02:16:55.549888 4047 catalog_manager.cc:5495] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8efca91956534cfdab26d01e45e0e308 (127.1.126.195). New cstate: current_term: 1 leader_uuid: "8efca91956534cfdab26d01e45e0e308" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } health_report { overall_health: HEALTHY } } }
I20260807 02:16:55.566939 4838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.562984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51996 (local address 127.1.126.195:43593)
0807 02:16:55.563208 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.563213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.563225 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:16:55.563323 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.563325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.563384 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.563568 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:55.563825 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.564419 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.565315 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.565622 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.566015 (+ 393us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.566083 (+ 68us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.566511 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.566646 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.566729 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.566784 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":86,"threads_started":1}
I20260807 02:16:55.577016 4763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.573873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:52573 (local address 127.1.126.193:40081)
0807 02:16:55.573994 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.573999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.574192 (+ 193us) server_negotiation.cc:407] Connection header received
0807 02:16:55.574325 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.574333 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.574375 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.574455 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:55.574737 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.575192 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.576015 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.576230 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.576335 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.576619 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.576682 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.576760 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.576848 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.576890 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 02:16:55.577042 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.573782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40081 (local address 127.1.126.195:52573)
0807 02:16:55.574083 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.574095 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.574222 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.574467 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.574470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.574478 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:55.574588 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.574598 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.575304 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.575307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.575898 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.575906 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.576340 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.576344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.576435 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.576480 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.576768 (+ 288us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.576776 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.576838 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.576911 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":101,"threads_started":1}
I20260807 02:16:55.583250 4455 raft_consensus.cc:1261] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Refusing update from remote peer 8efca91956534cfdab26d01e45e0e308: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:55.583344 4274 raft_consensus.cc:1261] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Refusing update from remote peer 8efca91956534cfdab26d01e45e0e308: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:55.583714 4836 consensus_queue.cc:1035] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:55.583886 4779 consensus_queue.cc:1035] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:55.603713 4838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.600042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:33971 (local address 127.1.126.195:43593)
0807 02:16:55.600153 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:55.600157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:55.600168 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:16:55.600211 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:55.600213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:55.600248 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:55.600327 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:55.600597 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.601279 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.602481 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.602859 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.602967 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.603233 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.603312 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.603383 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:55.603537 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 02:16:55.603586 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:16:55.603713 4821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:55.599828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:43593 (local address 127.1.126.193:33971)
0807 02:16:55.599943 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:55.599955 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:16:55.600051 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:16:55.600337 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:16:55.600340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:16:55.600348 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:16:55.600442 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.600447 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.601503 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.601508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.602358 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:16:55.602369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:16:55.602965 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:16:55.602968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:16:55.603063 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:55.603096 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:16:55.603416 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:16:55.603426 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 02:16:55.603503 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 02:16:55.603586 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 02:16:55.604673 4804 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 02:16:57.175230 4050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:57.175385 4050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:57.177795 4050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Sending DeleteTablet for 3 replicas of tablet 3639012fbb79411aa5dbdbf61ed74ff6
I20260807 02:16:57.178361 4242 tablet_service.cc:1514] Processing DeleteTablet for tablet 3639012fbb79411aa5dbdbf61ed74ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:57 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:56662
I20260807 02:16:57.178423 4447 tablet_service.cc:1514] Processing DeleteTablet for tablet 3639012fbb79411aa5dbdbf61ed74ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:57 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51746
I20260807 02:16:57.178498 4644 tablet_service.cc:1514] Processing DeleteTablet for tablet 3639012fbb79411aa5dbdbf61ed74ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:57 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260807 02:16:57.178776 4888 tablet_replica.cc:330] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: stopping tablet replica
I20260807 02:16:57.178926 4890 tablet_replica.cc:330] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: stopping tablet replica
I20260807 02:16:57.178951 4889 tablet_replica.cc:330] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: stopping tablet replica
I20260807 02:16:57.179070 4888 raft_consensus.cc:2229] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:57.179108 4889 raft_consensus.cc:2229] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:57.179217 4888 raft_consensus.cc:2258] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:57.179119 4890 raft_consensus.cc:2229] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:16:57.179267 4889 raft_consensus.cc:2258] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:57.179831 4890 raft_consensus.cc:2258] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:57.179939 4888 ts_tablet_manager.cc:1905] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:57.180019 4889 ts_tablet_manager.cc:1905] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:57.180565 4890 ts_tablet_manager.cc:1905] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 02:16:57 dist-test-slave-39l8 krb5kdc[3985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069017, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
I20260807 02:16:57.200531 4889 ts_tablet_manager.cc:1918] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 02:16:57.200531 4890 ts_tablet_manager.cc:1918] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 02:16:57.200626 4890 log.cc:1196] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/3639012fbb79411aa5dbdbf61ed74ff6
I20260807 02:16:57.200626 4889 log.cc:1196] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/3639012fbb79411aa5dbdbf61ed74ff6
I20260807 02:16:57.200968 4889 ts_tablet_manager.cc:1939] T 3639012fbb79411aa5dbdbf61ed74ff6 P 6992f29906964a8ca48f150804a62b0f: Deleting consensus metadata
I20260807 02:16:57.200976 4890 ts_tablet_manager.cc:1939] T 3639012fbb79411aa5dbdbf61ed74ff6 P 8efca91956534cfdab26d01e45e0e308: Deleting consensus metadata
Aug 07 02:16:57 dist-test-slave-39l8 krb5kdc[3985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069017, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:16:57.209337 4905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:57.200158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.1.126.254:38623)
0807 02:16:57.201161 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:57.201173 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:57.201192 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:16:57.201246 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:57.201252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:57.201313 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:57.201412 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:16:57.202272 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:57.202885 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:57.203829 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:57.204047 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:57.204132 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:57.206518 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:16:57.206521 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:16:57.206523 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:16:57.206546 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:16:57.207935 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:57.208318 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:57.208321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:57.208322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:57.208397 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:16:57.208639 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:16:57.208642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:16:57.208643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:16:57.208806 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:16:57.208906 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:57.209102 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 02:16:57.209208 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":836,"thread_start_us":107,"threads_started":1}
I20260807 02:16:57.211980 4050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:16:57.212457 4050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:57.217409 4447 tablet_service.cc:1467] Processing CreateTablet for tablet 3e83ba7d0a124978967ab9b72994f135 (DEFAULT_TABLE table=test-table [id=64203a0b1ae747019b6bfea4302fb51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:57.217410 4242 tablet_service.cc:1467] Processing CreateTablet for tablet 3e83ba7d0a124978967ab9b72994f135 (DEFAULT_TABLE table=test-table [id=64203a0b1ae747019b6bfea4302fb51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:57.217478 4644 tablet_service.cc:1467] Processing CreateTablet for tablet 3e83ba7d0a124978967ab9b72994f135 (DEFAULT_TABLE table=test-table [id=64203a0b1ae747019b6bfea4302fb51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:57.217715 4447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e83ba7d0a124978967ab9b72994f135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:57.217778 4644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e83ba7d0a124978967ab9b72994f135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:57.220194 4907 tablet_bootstrap.cc:492] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Bootstrap starting.
I20260807 02:16:57.220871 4908 tablet_bootstrap.cc:492] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Bootstrap starting.
I20260807 02:16:57.221333 4907 tablet_bootstrap.cc:654] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:57.222049 4908 tablet_bootstrap.cc:654] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:57.222463 4907 tablet_bootstrap.cc:492] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: No bootstrap required, opened a new log
I20260807 02:16:57.222575 4907 ts_tablet_manager.cc:1397] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:57.222990 4907 raft_consensus.cc:348] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.223114 4907 raft_consensus.cc:374] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:57.223155 4907 raft_consensus.cc:729] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Initialized, Role: FOLLOWER
I20260807 02:16:57.223661 4908 tablet_bootstrap.cc:492] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: No bootstrap required, opened a new log
I20260807 02:16:57.223769 4908 ts_tablet_manager.cc:1397] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:16:57.223862 4026 catalog_manager.cc:4841] TS 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593): tablet 3639012fbb79411aa5dbdbf61ed74ff6 (table test-table [id=383b0ab4eaca472b88c552f2f4ac7757]) successfully deleted
I20260807 02:16:57.224063 4242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e83ba7d0a124978967ab9b72994f135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:57.224102 4888 ts_tablet_manager.cc:1918] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 02:16:57.224160 4888 log.cc:1196] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/3639012fbb79411aa5dbdbf61ed74ff6
I20260807 02:16:57.224175 4026 catalog_manager.cc:4841] TS 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709): tablet 3639012fbb79411aa5dbdbf61ed74ff6 (table test-table [id=383b0ab4eaca472b88c552f2f4ac7757]) successfully deleted
I20260807 02:16:57.224336 4908 raft_consensus.cc:348] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.224457 4908 raft_consensus.cc:374] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:57.224466 4888 ts_tablet_manager.cc:1939] T 3639012fbb79411aa5dbdbf61ed74ff6 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting consensus metadata
I20260807 02:16:57.224502 4908 raft_consensus.cc:729] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6992f29906964a8ca48f150804a62b0f, State: Initialized, Role: FOLLOWER
I20260807 02:16:57.224639 4908 consensus_queue.cc:260] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.225062 4908 ts_tablet_manager.cc:1428] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 02:16:57.226836 4912 tablet_bootstrap.cc:492] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Bootstrap starting.
I20260807 02:16:57.223857 4907 consensus_queue.cc:260] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.227344 4907 ts_tablet_manager.cc:1428] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260807 02:16:57.227790 4912 tablet_bootstrap.cc:654] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:57.229043 4912 tablet_bootstrap.cc:492] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: No bootstrap required, opened a new log
I20260807 02:16:57.229156 4912 ts_tablet_manager.cc:1397] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 02:16:57.229588 4912 raft_consensus.cc:348] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.229725 4912 raft_consensus.cc:374] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:57.229770 4912 raft_consensus.cc:729] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Initialized, Role: FOLLOWER
I20260807 02:16:57.229933 4912 consensus_queue.cc:260] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.230245 4912 ts_tablet_manager.cc:1428] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:57.261906 4030 catalog_manager.cc:4841] TS f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081): tablet 3639012fbb79411aa5dbdbf61ed74ff6 (table test-table [id=383b0ab4eaca472b88c552f2f4ac7757]) successfully deleted
I20260807 02:16:57.279441 4875 raft_consensus.cc:482] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:57.279565 4875 raft_consensus.cc:504] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.280061 4875 leader_election.cc:288] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:57.280468 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e83ba7d0a124978967ab9b72994f135" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" is_pre_election: true
I20260807 02:16:57.280567 4484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e83ba7d0a124978967ab9b72994f135" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f" is_pre_election: true
I20260807 02:16:57.280653 4274 raft_consensus.cc:2454] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 0.
I20260807 02:16:57.280723 4484 raft_consensus.cc:2454] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 0.
I20260807 02:16:57.281038 4580 leader_election.cc:302] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, 8efca91956534cfdab26d01e45e0e308, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:57.281224 4875 raft_consensus.cc:2781] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:57.281308 4875 raft_consensus.cc:482] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:57.281375 4875 raft_consensus.cc:3037] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:57.297046 4875 raft_consensus.cc:504] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.297526 4875 leader_election.cc:288] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 election: Requested vote from peers f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081), 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709)
I20260807 02:16:57.297940 4274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e83ba7d0a124978967ab9b72994f135" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc"
I20260807 02:16:57.297957 4484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e83ba7d0a124978967ab9b72994f135" candidate_uuid: "8efca91956534cfdab26d01e45e0e308" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f"
I20260807 02:16:57.298102 4484 raft_consensus.cc:3037] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:57.298090 4274 raft_consensus.cc:3037] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:57.299333 4484 raft_consensus.cc:2454] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 1.
I20260807 02:16:57.299626 4274 raft_consensus.cc:2454] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8efca91956534cfdab26d01e45e0e308 in term 1.
I20260807 02:16:57.299718 4576 leader_election.cc:302] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, 8efca91956534cfdab26d01e45e0e308; no voters:
I20260807 02:16:57.299949 4875 raft_consensus.cc:2781] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:57.300068 4875 raft_consensus.cc:686] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 1 LEADER]: Becoming Leader. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Running, Role: LEADER
I20260807 02:16:57.300237 4875 consensus_queue.cc:237] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.302035 4047 catalog_manager.cc:5495] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8efca91956534cfdab26d01e45e0e308 (127.1.126.195). New cstate: current_term: 1 leader_uuid: "8efca91956534cfdab26d01e45e0e308" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } health_report { overall_health: HEALTHY } } }
I20260807 02:16:57.327579 4918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:57.323621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52002 (local address 127.1.126.195:43593)
0807 02:16:57.323907 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:57.323916 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:57.323930 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:16:57.323974 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:57.323977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:57.324025 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:57.324111 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:57.324397 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:57.325270 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:57.326402 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:57.326823 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:57.326920 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:57.327164 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:57.327247 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:57.327316 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:57.327379 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 02:16:57.327431 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":124,"threads_started":1}
I20260807 02:16:57.333806 4484 raft_consensus.cc:1261] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Refusing update from remote peer 8efca91956534cfdab26d01e45e0e308: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:57.333843 4274 raft_consensus.cc:1261] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Refusing update from remote peer 8efca91956534cfdab26d01e45e0e308: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:57.334187 4883 consensus_queue.cc:1035] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:57.334347 4875 consensus_queue.cc:1035] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:57.366856 4050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:57.367000 4050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:57.369007 4050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Sending DeleteTablet for 3 replicas of tablet 3e83ba7d0a124978967ab9b72994f135
I20260807 02:16:57.369575 4242 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e83ba7d0a124978967ab9b72994f135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:57 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:56662
I20260807 02:16:57.369601 4447 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e83ba7d0a124978967ab9b72994f135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:57 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51746
I20260807 02:16:57.369598 4644 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e83ba7d0a124978967ab9b72994f135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:57 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260807 02:16:57.369768 4889 tablet_replica.cc:330] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: stopping tablet replica
I20260807 02:16:57.369783 4888 tablet_replica.cc:330] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: stopping tablet replica
I20260807 02:16:57.369792 4890 tablet_replica.cc:330] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: stopping tablet replica
I20260807 02:16:57.369881 4889 raft_consensus.cc:2229] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:57.369889 4888 raft_consensus.cc:2229] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:57.369897 4890 raft_consensus.cc:2229] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:16:57.369993 4888 raft_consensus.cc:2258] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:57.369992 4889 raft_consensus.cc:2258] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:57.370091 4890 raft_consensus.cc:2258] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:57.370819 4890 ts_tablet_manager.cc:1905] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:57.370820 4888 ts_tablet_manager.cc:1905] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:57.372386 4050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 02:16:57.372547 4889 ts_tablet_manager.cc:1905] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 02:16:57.372792 4050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:16:57.377246 4242 tablet_service.cc:1467] Processing CreateTablet for tablet c3bd9438c6b8435b86255ae334e426ea (DEFAULT_TABLE table=test-table [id=88209ce77c8847a0b53f696df498c61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:57.377475 4447 tablet_service.cc:1467] Processing CreateTablet for tablet c3bd9438c6b8435b86255ae334e426ea (DEFAULT_TABLE table=test-table [id=88209ce77c8847a0b53f696df498c61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:57.377898 4644 tablet_service.cc:1467] Processing CreateTablet for tablet c3bd9438c6b8435b86255ae334e426ea (DEFAULT_TABLE table=test-table [id=88209ce77c8847a0b53f696df498c61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:16:57.395340 4242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3bd9438c6b8435b86255ae334e426ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:57.395340 4447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3bd9438c6b8435b86255ae334e426ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:57.396909 4644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3bd9438c6b8435b86255ae334e426ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:16:57.397857 4908 tablet_bootstrap.cc:492] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Bootstrap starting.
I20260807 02:16:57.399119 4890 ts_tablet_manager.cc:1918] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:57.399155 4908 tablet_bootstrap.cc:654] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:57.399199 4890 log.cc:1196] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/3e83ba7d0a124978967ab9b72994f135
I20260807 02:16:57.399526 4890 ts_tablet_manager.cc:1939] T 3e83ba7d0a124978967ab9b72994f135 P 8efca91956534cfdab26d01e45e0e308: Deleting consensus metadata
I20260807 02:16:57.399835 4912 tablet_bootstrap.cc:492] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc: Bootstrap starting.
I20260807 02:16:57.400642 4912 tablet_bootstrap.cc:654] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:57.400918 4907 tablet_bootstrap.cc:492] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Bootstrap starting.
I20260807 02:16:57.401499 4908 tablet_bootstrap.cc:492] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: No bootstrap required, opened a new log
I20260807 02:16:57.401633 4908 ts_tablet_manager.cc:1397] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 02:16:57.401793 4907 tablet_bootstrap.cc:654] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Neither blocks nor log segments found. Creating new log.
I20260807 02:16:57.401800 4912 tablet_bootstrap.cc:492] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc: No bootstrap required, opened a new log
I20260807 02:16:57.401885 4912 ts_tablet_manager.cc:1397] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:57.402143 4908 raft_consensus.cc:348] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.402261 4908 raft_consensus.cc:374] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:57.402303 4908 raft_consensus.cc:729] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6992f29906964a8ca48f150804a62b0f, State: Initialized, Role: FOLLOWER
I20260807 02:16:57.402320 4912 raft_consensus.cc:348] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.402419 4908 consensus_queue.cc:260] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.402479 4912 raft_consensus.cc:374] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:57.402536 4912 raft_consensus.cc:729] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Initialized, Role: FOLLOWER
I20260807 02:16:57.402757 4908 ts_tablet_manager.cc:1428] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260807 02:16:57.402652 4912 consensus_queue.cc:260] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.402920 4907 tablet_bootstrap.cc:492] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: No bootstrap required, opened a new log
I20260807 02:16:57.402992 4907 ts_tablet_manager.cc:1397] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:16:57.403002 4912 ts_tablet_manager.cc:1428] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:57.403402 4907 raft_consensus.cc:348] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.403518 4907 raft_consensus.cc:374] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:16:57.403558 4907 raft_consensus.cc:729] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efca91956534cfdab26d01e45e0e308, State: Initialized, Role: FOLLOWER
I20260807 02:16:57.403683 4907 consensus_queue.cc:260] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.403945 4907 ts_tablet_manager.cc:1428] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:16:57.417713 4888 ts_tablet_manager.cc:1918] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:57.417822 4888 log.cc:1196] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/3e83ba7d0a124978967ab9b72994f135
I20260807 02:16:57.418124 4888 ts_tablet_manager.cc:1939] T 3e83ba7d0a124978967ab9b72994f135 P f10adf7e46fe4a63b969a0168e7cc4dc: Deleting consensus metadata
I20260807 02:16:57.455628 4030 catalog_manager.cc:4841] TS f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081): tablet 3e83ba7d0a124978967ab9b72994f135 (table test-table [id=64203a0b1ae747019b6bfea4302fb51b]) successfully deleted
I20260807 02:16:57.483287 4785 raft_consensus.cc:482] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:16:57.483413 4785 raft_consensus.cc:504] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.483875 4785 leader_election.cc:288] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709), 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593)
I20260807 02:16:57.484349 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd9438c6b8435b86255ae334e426ea" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f" is_pre_election: true
I20260807 02:16:57.484386 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd9438c6b8435b86255ae334e426ea" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efca91956534cfdab26d01e45e0e308" is_pre_election: true
I20260807 02:16:57.484499 4455 raft_consensus.cc:2454] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 0.
I20260807 02:16:57.484584 4669 raft_consensus.cc:2454] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 0.
I20260807 02:16:57.484822 4178 leader_election.cc:302] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:57.485016 4785 raft_consensus.cc:2781] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:16:57.485085 4785 raft_consensus.cc:482] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:16:57.485124 4785 raft_consensus.cc:3037] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:57.488931 4026 catalog_manager.cc:4841] TS 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593): tablet 3e83ba7d0a124978967ab9b72994f135 (table test-table [id=64203a0b1ae747019b6bfea4302fb51b]) successfully deleted
I20260807 02:16:57.495384 4785 raft_consensus.cc:504] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.495494 4889 ts_tablet_manager.cc:1918] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:16:57.495576 4889 log.cc:1196] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/3e83ba7d0a124978967ab9b72994f135
I20260807 02:16:57.495815 4785 leader_election.cc:288] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 election: Requested vote from peers 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709), 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593)
I20260807 02:16:57.495879 4889 ts_tablet_manager.cc:1939] T 3e83ba7d0a124978967ab9b72994f135 P 6992f29906964a8ca48f150804a62b0f: Deleting consensus metadata
I20260807 02:16:57.496281 4455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd9438c6b8435b86255ae334e426ea" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6992f29906964a8ca48f150804a62b0f"
I20260807 02:16:57.496330 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3bd9438c6b8435b86255ae334e426ea" candidate_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efca91956534cfdab26d01e45e0e308"
I20260807 02:16:57.496412 4455 raft_consensus.cc:3037] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:57.496471 4669 raft_consensus.cc:3037] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:16:57.497413 4455 raft_consensus.cc:2454] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 1.
I20260807 02:16:57.497849 4178 leader_election.cc:302] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6992f29906964a8ca48f150804a62b0f, f10adf7e46fe4a63b969a0168e7cc4dc; no voters:
I20260807 02:16:57.497884 4669 raft_consensus.cc:2454] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f10adf7e46fe4a63b969a0168e7cc4dc in term 1.
I20260807 02:16:57.498078 4026 catalog_manager.cc:4841] TS 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709): tablet 3e83ba7d0a124978967ab9b72994f135 (table test-table [id=64203a0b1ae747019b6bfea4302fb51b]) successfully deleted
I20260807 02:16:57.498126 4785 raft_consensus.cc:2781] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:16:57.498311 4785 raft_consensus.cc:686] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [term 1 LEADER]: Becoming Leader. State: Replica: f10adf7e46fe4a63b969a0168e7cc4dc, State: Running, Role: LEADER
I20260807 02:16:57.498464 4785 consensus_queue.cc:237] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } }
I20260807 02:16:57.500378 4047 catalog_manager.cc:5495] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193). New cstate: current_term: 1 leader_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f10adf7e46fe4a63b969a0168e7cc4dc" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 } health_report { overall_health: UNKNOWN } } }
I20260807 02:16:57.545012 4928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:57.541400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56702 (local address 127.1.126.193:40081)
0807 02:16:57.541692 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 02:16:57.541700 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:16:57.541712 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:16:57.541751 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:16:57.541753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:16:57.541794 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:16:57.541864 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:16:57.542171 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:57.542697 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:57.543908 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:16:57.544147 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:16:57.544225 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:16:57.544511 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:16:57.544586 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:16:57.544643 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 02:16:57.544779 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 02:16:57.544826 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":140,"threads_started":1}
I20260807 02:16:57.552088 4669 raft_consensus.cc:1261] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Refusing update from remote peer f10adf7e46fe4a63b969a0168e7cc4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:57.552117 4455 raft_consensus.cc:1261] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Refusing update from remote peer f10adf7e46fe4a63b969a0168e7cc4dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:16:57.552533 4785 consensus_queue.cc:1035] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efca91956534cfdab26d01e45e0e308" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:16:57.552717 4854 consensus_queue.cc:1035] T c3bd9438c6b8435b86255ae334e426ea P f10adf7e46fe4a63b969a0168e7cc4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6992f29906964a8ca48f150804a62b0f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 02:16:57.567772 4850 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 02:16:59.121562 4047 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:59.121709 4047 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:16:59.123893 4047 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8f8ca6eb6ff418696e8e5b3bbed9da2: Sending DeleteTablet for 3 replicas of tablet c3bd9438c6b8435b86255ae334e426ea
I20260807 02:16:59.124452 4242 tablet_service.cc:1514] Processing DeleteTablet for tablet c3bd9438c6b8435b86255ae334e426ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:59 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:56662
I20260807 02:16:59.124701 4447 tablet_service.cc:1514] Processing DeleteTablet for tablet c3bd9438c6b8435b86255ae334e426ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:59 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51746
I20260807 02:16:59.124780 4644 tablet_service.cc:1514] Processing DeleteTablet for tablet c3bd9438c6b8435b86255ae334e426ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:16:59 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:51986
I20260807 02:16:59.124946 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 4154
I20260807 02:16:59.130558 4961 tablet_replica.cc:330] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: stopping tablet replica
I20260807 02:16:59.130743 4961 raft_consensus.cc:2229] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:59.130903 4961 raft_consensus.cc:2258] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:59.131116 4960 tablet_replica.cc:330] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: stopping tablet replica
I20260807 02:16:59.131274 4960 raft_consensus.cc:2229] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:16:59.131377 4960 raft_consensus.cc:2258] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:16:59.132305 4960 ts_tablet_manager.cc:1905] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:59.134864 4960 ts_tablet_manager.cc:1918] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 02:16:59.134956 4960 log.cc:1196] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/c3bd9438c6b8435b86255ae334e426ea
I20260807 02:16:59.135279 4960 ts_tablet_manager.cc:1939] T c3bd9438c6b8435b86255ae334e426ea P 6992f29906964a8ca48f150804a62b0f: Deleting consensus metadata
I20260807 02:16:59.136001 4026 catalog_manager.cc:4841] TS 6992f29906964a8ca48f150804a62b0f (127.1.126.194:39709): tablet c3bd9438c6b8435b86255ae334e426ea (table test-table [id=88209ce77c8847a0b53f696df498c61e]) successfully deleted
I20260807 02:16:59.136330 4961 ts_tablet_manager.cc:1905] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:16:59.138384 4961 ts_tablet_manager.cc:1918] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 02:16:59.138480 4961 log.cc:1196] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/c3bd9438c6b8435b86255ae334e426ea
I20260807 02:16:59.138796 4961 ts_tablet_manager.cc:1939] T c3bd9438c6b8435b86255ae334e426ea P 8efca91956534cfdab26d01e45e0e308: Deleting consensus metadata
I20260807 02:16:59.139456 4026 catalog_manager.cc:4841] TS 8efca91956534cfdab26d01e45e0e308 (127.1.126.195:43593): tablet c3bd9438c6b8435b86255ae334e426ea (table test-table [id=88209ce77c8847a0b53f696df498c61e]) successfully deleted
W20260807 02:16:59.141436 4030 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:40081 (error 108)
I20260807 02:16:59.141608 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 4358
I20260807 02:16:59.152136 4964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:16:59.151583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40081 (local address 127.0.0.1:56716)
0807 02:16:59.151878 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 02:16:59.151981 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":88,"threads_started":1}
W20260807 02:16:59.152311 4030 catalog_manager.cc:4584] TS f10adf7e46fe4a63b969a0168e7cc4dc (127.1.126.193:40081): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3bd9438c6b8435b86255ae334e426ea: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40081: connect: Connection refused (error 111)
I20260807 02:16:59.157307 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 4559
I20260807 02:16:59.169658 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 4000
2026-08-07T02:16:59Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6672 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:16:59 dist-test-slave-39l8 krb5kdc[4968](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:16:59 dist-test-slave-39l8 krb5kdc[4968](info): set up 2 sockets
Aug 07 02:16:59 dist-test-slave-39l8 krb5kdc[4968](info): commencing operation
krb5kdc: starting...
W20260807 02:17:00.375810 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:00 dist-test-slave-39l8 krb5kdc[4968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:00.497870 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46805
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:46805
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:00.605856 4985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:00.606101 4985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:00.606140 4985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:00.610083 4985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:00.610133 4985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:00.610152 4985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:00.610169 4985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:00.610221 4985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:00.615278 4985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:46805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:00.616214 4985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:00.617213 4985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:00.625720 4995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:00.625672 4994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:00.625766 4985 server_base.cc:1034] running on GCE node
W20260807 02:17:00.625787 4998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:00.626576 4985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:00.627617 4985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:00.628806 4985 hybrid_clock.cc:648] HybridClock initialized: now 1786069020628782 us; error 37 us; skew 500 ppm
Aug 07 02:17:00 dist-test-slave-39l8 krb5kdc[4968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:00.631522 4985 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:00.632355 4985 webserver.cc:460] Webserver started at http://127.1.126.254:35429/ using document root <none> and password file <none>
I20260807 02:17:00.632956 4985 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:00.633045 4985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:00.633289 4985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:00.635373 4985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "e65cf8198a234e7da16a30bf160dde51"
format_stamp: "Formatted at 2026-08-07 02:17:00 on dist-test-slave-39l8"
server_key: "76cb3fab4b11f2b3fa7f1767f0520d4a"
server_key_iv: "d1593f06aaa7fea2d131710f5f397c89"
server_key_version: "encryptionkey@0"
I20260807 02:17:00.635959 4985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "e65cf8198a234e7da16a30bf160dde51"
format_stamp: "Formatted at 2026-08-07 02:17:00 on dist-test-slave-39l8"
server_key: "76cb3fab4b11f2b3fa7f1767f0520d4a"
server_key_iv: "d1593f06aaa7fea2d131710f5f397c89"
server_key_version: "encryptionkey@0"
I20260807 02:17:00.639588 4985 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:00.641876 5005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:00.643122 4985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:00.643260 4985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "e65cf8198a234e7da16a30bf160dde51"
format_stamp: "Formatted at 2026-08-07 02:17:00 on dist-test-slave-39l8"
server_key: "76cb3fab4b11f2b3fa7f1767f0520d4a"
server_key_iv: "d1593f06aaa7fea2d131710f5f397c89"
server_key_version: "encryptionkey@0"
I20260807 02:17:00.643366 4985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:00.669364 4985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:00.672189 4985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:00.672385 4985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:00.679234 4985 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:46805
I20260807 02:17:00.679263 5081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:46805 every 8 connection(s)
I20260807 02:17:00.680141 4985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:00.682976 5082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:00.683420 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 4985
I20260807 02:17:00.683504 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:00.683785 1531 external_mini_cluster.cc:1428] Setting key 5ce11581613bd899d0553d4dda782760
I20260807 02:17:00.689509 5082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51: Bootstrap starting.
I20260807 02:17:00.692302 5082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:00.693185 5082 log.cc:824] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51: Log is configured to *not* fsync() on all Append() calls
Aug 07 02:17:00 dist-test-slave-39l8 krb5kdc[4968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:00.695446 5082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51: No bootstrap required, opened a new log
I20260807 02:17:00.698565 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:00.685293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37022 (local address 127.1.126.254:46805)
0807 02:17:00.685720 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:00.685739 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:00.685781 (+ 42us) server_negotiation.cc:407] Connection header received
0807 02:17:00.686631 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:00.686654 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:00.687095 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:00.687436 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:00.688124 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:00.689544 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:00.690411 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:00.691254 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:00.691411 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:00.694138 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:00.694144 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:00.694156 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:00.694183 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:00.695861 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:00.696304 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:00.696309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:00.696313 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:00.696419 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:00.696712 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:00.696715 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:00.696717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:00.697103 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:00.697291 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:00.697590 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 02:17:00.697867 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":106,"threads_started":1}
I20260807 02:17:00.699005 5082 raft_consensus.cc:348] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e65cf8198a234e7da16a30bf160dde51" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46805 } }
I20260807 02:17:00.699242 5082 raft_consensus.cc:374] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:00.699337 5082 raft_consensus.cc:729] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e65cf8198a234e7da16a30bf160dde51, State: Initialized, Role: FOLLOWER
I20260807 02:17:00.699791 5082 consensus_queue.cc:260] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e65cf8198a234e7da16a30bf160dde51" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46805 } }
I20260807 02:17:00.699913 5082 raft_consensus.cc:388] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:00.699994 5082 raft_consensus.cc:482] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:00.700103 5082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:00.701056 5082 raft_consensus.cc:504] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e65cf8198a234e7da16a30bf160dde51" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46805 } }
I20260807 02:17:00.701382 5082 leader_election.cc:302] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e65cf8198a234e7da16a30bf160dde51; no voters:
I20260807 02:17:00.701694 5082 leader_election.cc:288] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:00.701818 5092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:00.702076 5092 raft_consensus.cc:686] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [term 1 LEADER]: Becoming Leader. State: Replica: e65cf8198a234e7da16a30bf160dde51, State: Running, Role: LEADER
I20260807 02:17:00.702436 5092 consensus_queue.cc:237] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e65cf8198a234e7da16a30bf160dde51" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46805 } }
I20260807 02:17:00.702936 5082 sys_catalog.cc:564] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:00.704025 5098 sys_catalog.cc:455] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e65cf8198a234e7da16a30bf160dde51. Latest consensus state: current_term: 1 leader_uuid: "e65cf8198a234e7da16a30bf160dde51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e65cf8198a234e7da16a30bf160dde51" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46805 } } }
I20260807 02:17:00.704175 5098 sys_catalog.cc:458] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:00.704522 5094 sys_catalog.cc:455] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e65cf8198a234e7da16a30bf160dde51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e65cf8198a234e7da16a30bf160dde51" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46805 } } }
I20260807 02:17:00.704612 5094 sys_catalog.cc:458] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:00.704630 5108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:00.708185 5108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:00.713550 5108 catalog_manager.cc:1347] Generated new cluster ID: 5b60a6a67d094a9c99e1e045989870ed
I20260807 02:17:00.713613 5108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:00.732903 5108 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:00.734409 5108 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:00.739434 5108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e65cf8198a234e7da16a30bf160dde51: Generated new TSK 0
I20260807 02:17:00.740082 5108 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:00.767390 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46805
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:00.878582 5126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:00.878911 5126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:00.878996 5126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:00.883071 5126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:00.883152 5126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:00.883235 5126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:00.888433 5126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:00.889464 5126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:00.890499 5126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:00.899894 5133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:00.899891 5132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:00.900071 5126 server_base.cc:1034] running on GCE node
W20260807 02:17:00.899976 5135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:00.900494 5126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:00.901139 5126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:00.902292 5126 hybrid_clock.cc:648] HybridClock initialized: now 1786069020902265 us; error 40 us; skew 500 ppm
Aug 07 02:17:00 dist-test-slave-39l8 krb5kdc[4968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:00.905216 5126 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:00.905977 5126 webserver.cc:460] Webserver started at http://127.1.126.193:45369/ using document root <none> and password file <none>
I20260807 02:17:00.906476 5126 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:00.906531 5126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:00.906752 5126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:00.908699 5126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "0a431fedf05b49eb815c6b796aebaa3c"
format_stamp: "Formatted at 2026-08-07 02:17:00 on dist-test-slave-39l8"
server_key: "f46128418f67201c0914980a0b741068"
server_key_iv: "7d68950b07dfd9bf2c4006578c5e4560"
server_key_version: "encryptionkey@0"
I20260807 02:17:00.909190 5126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "0a431fedf05b49eb815c6b796aebaa3c"
format_stamp: "Formatted at 2026-08-07 02:17:00 on dist-test-slave-39l8"
server_key: "f46128418f67201c0914980a0b741068"
server_key_iv: "7d68950b07dfd9bf2c4006578c5e4560"
server_key_version: "encryptionkey@0"
I20260807 02:17:00.912735 5126 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:00.915047 5145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:00.916239 5126 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:17:00.916369 5126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "0a431fedf05b49eb815c6b796aebaa3c"
format_stamp: "Formatted at 2026-08-07 02:17:00 on dist-test-slave-39l8"
server_key: "f46128418f67201c0914980a0b741068"
server_key_iv: "7d68950b07dfd9bf2c4006578c5e4560"
server_key_version: "encryptionkey@0"
I20260807 02:17:00.916497 5126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:00.942054 5126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:00.944928 5126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:00.945140 5126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:00.945724 5126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:00.946591 5126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:00.946660 5126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:00.946751 5126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:00.946816 5126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:00.956169 5126 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:46521
I20260807 02:17:00.956194 5307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:46521 every 8 connection(s)
I20260807 02:17:00.956991 5126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:00.963768 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 5126
I20260807 02:17:00.963896 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:00.964174 1531 external_mini_cluster.cc:1428] Setting key de4b026ba54d0a36233eb220215e3a42
Aug 07 02:17:00 dist-test-slave-39l8 krb5kdc[4968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:00.970867 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:00.958802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:50339 (local address 127.1.126.254:46805)
0807 02:17:00.958955 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:00.958960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:00.959793 (+ 833us) server_negotiation.cc:407] Connection header received
0807 02:17:00.961051 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:00.961054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:00.961101 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:00.961180 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:00.962240 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:00.962812 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:00.963933 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:00.964302 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:00.964418 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:00.967051 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:00.967058 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:00.967064 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:00.967097 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:00.968606 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:00.969283 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:00.969285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:00.969286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:00.969358 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:00.969734 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:00.969736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:00.969737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:00.969915 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:00.969990 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:00.970588 (+ 598us) server_negotiation.cc:299] Negotiation successful
0807 02:17:00.970693 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:17:00.972055 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:00.959186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46805 (local address 127.1.126.193:50339)
0807 02:17:00.959640 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:00.959680 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:00.960862 (+ 1182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:00.961334 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:00.961340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:00.961688 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:00.962116 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:00.962128 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:00.962919 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:00.962922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:00.963762 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:00.963772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:00.964449 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:00.964452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:00.964639 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:00.965237 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:00.965267 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:00.966888 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:00.968725 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:00.968733 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:00.968746 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:00.969152 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:00.969445 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:00.969451 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:00.969456 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:00.969637 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:00.970021 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:00.970030 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:00.970341 (+ 311us) client_negotiation.cc:769] Sending connection context
0807 02:17:00.970546 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 02:17:00.970945 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":113,"threads_started":1}
I20260807 02:17:00.973352 5308 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46805
I20260807 02:17:00.973587 5308 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:00.974051 5308 heartbeater.cc:511] Master 127.1.126.254:46805 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:17:00.975627 5029 ts_manager.cc:194] Registered new tserver with Master: 0a431fedf05b49eb815c6b796aebaa3c (127.1.126.193:46521)
I20260807 02:17:00.976732 5029 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:50339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:00.991791 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46805
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:01.104499 5314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:01.104797 5314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:01.104892 5314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:01.108976 5314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:01.109073 5314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:01.109160 5314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:01.114423 5314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:01.115525 5314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:01.116539 5314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:01.125991 5323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:01.126003 5319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:01.126003 5321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:01.126055 5314 server_base.cc:1034] running on GCE node
I20260807 02:17:01.126684 5314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:01.127321 5314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:01.128476 5314 hybrid_clock.cc:648] HybridClock initialized: now 1786069021128464 us; error 23 us; skew 500 ppm
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[4968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069021, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:01.131376 5314 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:01.132253 5314 webserver.cc:460] Webserver started at http://127.1.126.194:40809/ using document root <none> and password file <none>
I20260807 02:17:01.132805 5314 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:01.132865 5314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:01.133071 5314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:01.135133 5314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "0703b3e4ac424d748c381543d074b2e3"
format_stamp: "Formatted at 2026-08-07 02:17:01 on dist-test-slave-39l8"
server_key: "aa949eb28db8a0a7e840a61f215a6e51"
server_key_iv: "1b812201d5fbb2137ab5b8e1dd3845e1"
server_key_version: "encryptionkey@0"
I20260807 02:17:01.135708 5314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "0703b3e4ac424d748c381543d074b2e3"
format_stamp: "Formatted at 2026-08-07 02:17:01 on dist-test-slave-39l8"
server_key: "aa949eb28db8a0a7e840a61f215a6e51"
server_key_iv: "1b812201d5fbb2137ab5b8e1dd3845e1"
server_key_version: "encryptionkey@0"
I20260807 02:17:01.139562 5314 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:17:01.143249 5334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:01.144330 5314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:01.144452 5314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "0703b3e4ac424d748c381543d074b2e3"
format_stamp: "Formatted at 2026-08-07 02:17:01 on dist-test-slave-39l8"
server_key: "aa949eb28db8a0a7e840a61f215a6e51"
server_key_iv: "1b812201d5fbb2137ab5b8e1dd3845e1"
server_key_version: "encryptionkey@0"
I20260807 02:17:01.144564 5314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:01.155464 5314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:01.158133 5314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:01.158324 5314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:01.158983 5314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:01.159801 5314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:01.159848 5314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:01.159915 5314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:01.159955 5314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:01.168637 5314 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:45353
I20260807 02:17:01.168663 5491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:45353 every 8 connection(s)
I20260807 02:17:01.169487 5314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:01.177783 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 5314
I20260807 02:17:01.177911 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:01.178267 1531 external_mini_cluster.cc:1428] Setting key 80beb498a7928a8dc26a8c350b70447b
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[4968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069021, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:01.183684 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:01.171285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:49501 (local address 127.1.126.254:46805)
0807 02:17:01.171430 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:01.171434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:01.172243 (+ 809us) server_negotiation.cc:407] Connection header received
0807 02:17:01.173579 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:01.173582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:01.173653 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:01.173764 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:01.174977 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.175557 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.176708 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.176931 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.177043 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:01.179893 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:01.179897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:01.179901 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:01.179927 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:01.181580 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:01.182074 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:01.182079 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:01.182081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:01.182175 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:01.182510 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:01.182516 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:01.182517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:01.182756 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:01.182871 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:01.183386 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 02:17:01.183516 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:17:01.184500 5496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:01.171647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46805 (local address 127.1.126.194:49501)
0807 02:17:01.172089 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:01.172129 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:01.173369 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:01.173932 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:01.173938 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:01.174272 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:01.174837 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:01.174853 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.175698 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.175702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:01.176577 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:01.176586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.177082 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.177086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:01.177252 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:01.177796 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:01.177820 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:01.179701 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:01.181700 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:01.181705 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:01.181716 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:01.181956 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:01.182273 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:01.182277 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:01.182279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:01.182411 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:01.182871 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:01.182879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:01.183148 (+ 269us) client_negotiation.cc:769] Sending connection context
0807 02:17:01.183339 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 02:17:01.183653 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260807 02:17:01.185686 5493 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46805
I20260807 02:17:01.185931 5493 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:01.186404 5493 heartbeater.cc:511] Master 127.1.126.254:46805 requested a full tablet report, sending...
I20260807 02:17:01.187542 5029 ts_manager.cc:194] Registered new tserver with Master: 0703b3e4ac424d748c381543d074b2e3 (127.1.126.194:45353)
I20260807 02:17:01.188110 5029 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:49501
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:01.206975 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46805
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:01.318480 5499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:01.318742 5499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:01.318783 5499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:01.323062 5499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:01.323117 5499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:01.323221 5499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:01.328374 5499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:01.329424 5499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:01.330442 5499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:01.340042 5509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:01.340133 5511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:01.340061 5513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:01.340268 5499 server_base.cc:1034] running on GCE node
I20260807 02:17:01.340832 5499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:01.341446 5499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:01.342633 5499 hybrid_clock.cc:648] HybridClock initialized: now 1786069021342621 us; error 26 us; skew 500 ppm
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[4968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069021, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:01.345278 5499 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:01.346240 5499 webserver.cc:460] Webserver started at http://127.1.126.195:45567/ using document root <none> and password file <none>
I20260807 02:17:01.346861 5499 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:01.346953 5499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:01.347182 5499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:01.349188 5499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "93236bb107f64a27be2415557acf0695"
format_stamp: "Formatted at 2026-08-07 02:17:01 on dist-test-slave-39l8"
server_key: "a46c9d358027a810bf1d1aee1253c156"
server_key_iv: "54a5225ebdda765a1588d93c8d093bdb"
server_key_version: "encryptionkey@0"
I20260807 02:17:01.349752 5499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "93236bb107f64a27be2415557acf0695"
format_stamp: "Formatted at 2026-08-07 02:17:01 on dist-test-slave-39l8"
server_key: "a46c9d358027a810bf1d1aee1253c156"
server_key_iv: "54a5225ebdda765a1588d93c8d093bdb"
server_key_version: "encryptionkey@0"
I20260807 02:17:01.353327 5499 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:01.355705 5523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:01.356897 5499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:01.357033 5499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "93236bb107f64a27be2415557acf0695"
format_stamp: "Formatted at 2026-08-07 02:17:01 on dist-test-slave-39l8"
server_key: "a46c9d358027a810bf1d1aee1253c156"
server_key_iv: "54a5225ebdda765a1588d93c8d093bdb"
server_key_version: "encryptionkey@0"
I20260807 02:17:01.357137 5499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:01.371917 5499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:01.374614 5499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:01.374843 5499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:01.375401 5499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:01.376219 5499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:01.376291 5499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:01.376363 5499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:01.376405 5499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:01.385298 5499 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:44279
I20260807 02:17:01.385319 5677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:44279 every 8 connection(s)
I20260807 02:17:01.386178 5499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:01.393703 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 5499
I20260807 02:17:01.393848 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:01.394142 1531 external_mini_cluster.cc:1428] Setting key 8e46b71faa0d823a953730c43879eb7c
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[4968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069021, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:01.400091 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:01.388022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:39503 (local address 127.1.126.254:46805)
0807 02:17:01.388178 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:01.388182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:01.388962 (+ 780us) server_negotiation.cc:407] Connection header received
0807 02:17:01.390309 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:01.390313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:01.390373 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:01.390484 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:01.391715 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.392291 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.393426 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.393762 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.393888 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:01.396596 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:01.396600 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:01.396603 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:01.396638 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:01.397928 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:01.398390 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:01.398393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:01.398394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:01.398470 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:01.398821 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:01.398824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:01.398825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:01.399006 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:01.399085 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:01.399853 (+ 768us) server_negotiation.cc:299] Negotiation successful
0807 02:17:01.399970 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:17:01.400882 5683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:01.388382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46805 (local address 127.1.126.195:39503)
0807 02:17:01.388821 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:01.388861 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:01.390102 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:01.390661 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:01.390668 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:01.391081 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:01.391561 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:01.391574 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.392426 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.392435 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:01.393295 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:01.393304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:01.393965 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:01.393969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:01.394116 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:01.394814 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:01.394830 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:01.396421 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:01.398031 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:01.398036 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:01.398048 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:01.398304 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:01.398547 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:01.398549 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:01.398551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:01.398691 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:01.399135 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:01.399143 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:01.399488 (+ 345us) client_negotiation.cc:769] Sending connection context
0807 02:17:01.399750 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 02:17:01.400038 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":107,"threads_started":1}
I20260807 02:17:01.401962 5681 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46805
I20260807 02:17:01.402175 5681 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:01.402634 5681 heartbeater.cc:511] Master 127.1.126.254:46805 requested a full tablet report, sending...
I20260807 02:17:01.403716 5029 ts_manager.cc:194] Registered new tserver with Master: 93236bb107f64a27be2415557acf0695 (127.1.126.195:44279)
I20260807 02:17:01.404587 5029 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:39503
I20260807 02:17:01.408140 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 02:17:01.422188 5090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:01.420756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36594 (local address 127.1.126.254:46805)
0807 02:17:01.420936 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:01.420942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:01.421099 (+ 157us) server_negotiation.cc:407] Connection header received
0807 02:17:01.421231 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:01.421233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:01.421278 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:01.421354 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:01.422018 (+ 664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36594: BlockingRecv error: recv got EOF from 127.0.0.1:36594 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 02:17:01.423681 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 5126
I20260807 02:17:01.437755 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 5314
I20260807 02:17:01.450793 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 5499
I20260807 02:17:01.461995 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 4985
2026-08-07T02:17:01Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2291 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[5700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[5700](info): set up 2 sockets
Aug 07 02:17:01 dist-test-slave-39l8 krb5kdc[5700](info): commencing operation
krb5kdc: starting...
W20260807 02:17:02.660079 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:02 dist-test-slave-39l8 krb5kdc[5700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:02.777766 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37991
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:41659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:37991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:02.886224 5719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:02.886456 5719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:02.886494 5719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:02.890605 5719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:02.890656 5719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:02.890681 5719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:02.890762 5719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:02.890805 5719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:02.895705 5719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:37991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:02.896612 5719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:02.897575 5719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:02.905750 5729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:02.905795 5727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:02.905923 5719 server_base.cc:1034] running on GCE node
W20260807 02:17:02.905766 5726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:02.906579 5719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:02.907703 5719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:02.908934 5719 hybrid_clock.cc:648] HybridClock initialized: now 1786069022908920 us; error 35 us; skew 500 ppm
Aug 07 02:17:02 dist-test-slave-39l8 krb5kdc[5700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069022, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:02.911674 5719 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:02.912526 5719 webserver.cc:460] Webserver started at http://127.1.126.254:44685/ using document root <none> and password file <none>
I20260807 02:17:02.913077 5719 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:02.913175 5719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:02.913399 5719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:02.915417 5719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "f72e3125eb72404284b2245f0fee85f3"
format_stamp: "Formatted at 2026-08-07 02:17:02 on dist-test-slave-39l8"
server_key: "8d75251fbbaffaf313366a10c24b451d"
server_key_iv: "7a16c38ec4c62600a4852cfb454d2fe2"
server_key_version: "encryptionkey@0"
I20260807 02:17:02.915977 5719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "f72e3125eb72404284b2245f0fee85f3"
format_stamp: "Formatted at 2026-08-07 02:17:02 on dist-test-slave-39l8"
server_key: "8d75251fbbaffaf313366a10c24b451d"
server_key_iv: "7a16c38ec4c62600a4852cfb454d2fe2"
server_key_version: "encryptionkey@0"
I20260807 02:17:02.919500 5719 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:02.921797 5740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:02.922991 5719 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:02.923136 5719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "f72e3125eb72404284b2245f0fee85f3"
format_stamp: "Formatted at 2026-08-07 02:17:02 on dist-test-slave-39l8"
server_key: "8d75251fbbaffaf313366a10c24b451d"
server_key_iv: "7a16c38ec4c62600a4852cfb454d2fe2"
server_key_version: "encryptionkey@0"
I20260807 02:17:02.923244 5719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:02.935925 5719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:02.938514 5719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:02.938740 5719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:02.945595 5719 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:37991
I20260807 02:17:02.945971 5809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:37991 every 8 connection(s)
I20260807 02:17:02.946540 5719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:02.949344 5811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:02.953984 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 5719
I20260807 02:17:02.954149 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:02.954416 1531 external_mini_cluster.cc:1428] Setting key a75f0f359185d0d9391c403ae8616f37
I20260807 02:17:02.955003 5811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3: Bootstrap starting.
I20260807 02:17:02.957331 5811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:02.958123 5811 log.cc:824] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:02.960057 5811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3: No bootstrap required, opened a new log
Aug 07 02:17:02 dist-test-slave-39l8 krb5kdc[5700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:02.964309 5811 raft_consensus.cc:348] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f72e3125eb72404284b2245f0fee85f3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37991 } }
I20260807 02:17:02.964550 5811 raft_consensus.cc:374] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:02.964654 5811 raft_consensus.cc:729] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f72e3125eb72404284b2245f0fee85f3, State: Initialized, Role: FOLLOWER
I20260807 02:17:02.965107 5811 consensus_queue.cc:260] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f72e3125eb72404284b2245f0fee85f3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37991 } }
I20260807 02:17:02.965265 5811 raft_consensus.cc:388] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:02.965380 5811 raft_consensus.cc:482] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:02.965513 5811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:02.966586 5811 raft_consensus.cc:504] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f72e3125eb72404284b2245f0fee85f3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37991 } }
I20260807 02:17:02.966975 5811 leader_election.cc:302] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f72e3125eb72404284b2245f0fee85f3; no voters:
I20260807 02:17:02.967289 5811 leader_election.cc:288] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:02.967393 5818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:02.967703 5818 raft_consensus.cc:686] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [term 1 LEADER]: Becoming Leader. State: Replica: f72e3125eb72404284b2245f0fee85f3, State: Running, Role: LEADER
I20260807 02:17:02.968219 5818 consensus_queue.cc:237] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f72e3125eb72404284b2245f0fee85f3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37991 } }
I20260807 02:17:02.968618 5811 sys_catalog.cc:564] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:02.969025 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:02.955711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42048 (local address 127.1.126.254:37991)
0807 02:17:02.956180 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:02.956193 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:02.956226 (+ 33us) server_negotiation.cc:407] Connection header received
0807 02:17:02.956806 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:02.956820 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:02.957106 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:02.957428 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:02.958285 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:02.959472 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:02.960384 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:02.960839 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:02.961011 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:02.963818 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:02.963823 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:02.963835 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:02.963861 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:02.965828 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:02.966319 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:02.966323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:02.966327 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:02.966430 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:02.966805 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:02.966811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:02.966813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:02.967232 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:02.967443 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:02.967808 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 02:17:02.968142 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":126,"threads_started":1}
I20260807 02:17:02.969375 5818 sys_catalog.cc:455] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f72e3125eb72404284b2245f0fee85f3. Latest consensus state: current_term: 1 leader_uuid: "f72e3125eb72404284b2245f0fee85f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f72e3125eb72404284b2245f0fee85f3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37991 } } }
I20260807 02:17:02.969489 5818 sys_catalog.cc:458] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:02.969849 5828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:02.970165 5820 sys_catalog.cc:455] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f72e3125eb72404284b2245f0fee85f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f72e3125eb72404284b2245f0fee85f3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37991 } } }
I20260807 02:17:02.970243 5820 sys_catalog.cc:458] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:02.972250 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:17:02.975678 5828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:02.981212 5828 catalog_manager.cc:1347] Generated new cluster ID: 9a0a47199bba4ff787b684423808ec89
I20260807 02:17:02.981268 5828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:02.993820 5816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:02.988368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42054 (local address 127.1.126.254:37991)
0807 02:17:02.988465 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:02.988469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:02.988743 (+ 274us) server_negotiation.cc:407] Connection header received
0807 02:17:02.988844 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:02.988847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:02.988900 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:02.988980 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:02.989500 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:02.990309 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:02.991446 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:02.991822 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:02.991930 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:02.992838 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:02.992843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:02.992846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:02.993364 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:02.993396 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:02.993415 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:02.993503 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:02.993623 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 02:17:02.993683 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 02:17:02.996035 5828 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:02.997359 5828 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:03.002753 5828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f72e3125eb72404284b2245f0fee85f3: Generated new TSK 0
I20260807 02:17:03.003479 5828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:03.008750 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 5719
2026-08-07T02:17:03Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1548 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:03 dist-test-slave-39l8 krb5kdc[5857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:03 dist-test-slave-39l8 krb5kdc[5857](info): set up 2 sockets
Aug 07 02:17:03 dist-test-slave-39l8 krb5kdc[5857](info): commencing operation
krb5kdc: starting...
W20260807 02:17:04.225672 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:04 dist-test-slave-39l8 krb5kdc[5857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:04.346920 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36811
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:04.457278 5878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:04.457515 5878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:04.457554 5878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:04.462177 5878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:04.462234 5878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:04.462253 5878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:04.462270 5878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:04.462284 5878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:04.467434 5878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:04.468358 5878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:04.469298 5878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:04.477948 5884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:04.477948 5883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:04.478087 5878 server_base.cc:1034] running on GCE node
W20260807 02:17:04.477924 5886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:04.478821 5878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:04.479883 5878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:04.481065 5878 hybrid_clock.cc:648] HybridClock initialized: now 1786069024481055 us; error 39 us; skew 500 ppm
Aug 07 02:17:04 dist-test-slave-39l8 krb5kdc[5857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:04.486766 5878 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:04.487694 5878 webserver.cc:460] Webserver started at http://127.1.126.254:43555/ using document root <none> and password file <none>
I20260807 02:17:04.488533 5878 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:04.488638 5878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:04.488864 5878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:04.490938 5878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "604b2928339948088c0ba554f75b84b0"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "a7aa20dd8aae0eb9d83df89178f9ad54"
server_key_iv: "fac6a38e539a9aab4d6652b919627a5d"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.491535 5878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "604b2928339948088c0ba554f75b84b0"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "a7aa20dd8aae0eb9d83df89178f9ad54"
server_key_iv: "fac6a38e539a9aab4d6652b919627a5d"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.495149 5878 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:04.497454 5900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:04.498627 5878 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:04.498792 5878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "604b2928339948088c0ba554f75b84b0"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "a7aa20dd8aae0eb9d83df89178f9ad54"
server_key_iv: "fac6a38e539a9aab4d6652b919627a5d"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.498903 5878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:04.516536 5878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:04.519282 5878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:04.519472 5878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:04.526477 5878 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36811
I20260807 02:17:04.526798 5970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36811 every 8 connection(s)
I20260807 02:17:04.527465 5878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:04.530136 5971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:04.532786 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 5878
I20260807 02:17:04.532879 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:04.533159 1531 external_mini_cluster.cc:1428] Setting key 8d800af7a0842493f217d2bb52d3877e
I20260807 02:17:04.535813 5971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0: Bootstrap starting.
I20260807 02:17:04.538484 5971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:04.539359 5971 log.cc:824] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:04.541620 5971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0: No bootstrap required, opened a new log
Aug 07 02:17:04 dist-test-slave-39l8 krb5kdc[5857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:04.544530 5971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604b2928339948088c0ba554f75b84b0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36811 } }
I20260807 02:17:04.544732 5971 raft_consensus.cc:374] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:04.544785 5971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604b2928339948088c0ba554f75b84b0, State: Initialized, Role: FOLLOWER
I20260807 02:17:04.545164 5971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604b2928339948088c0ba554f75b84b0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36811 } }
I20260807 02:17:04.545274 5971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:04.545347 5971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:04.545441 5971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:04.546404 5971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604b2928339948088c0ba554f75b84b0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36811 } }
I20260807 02:17:04.546798 5971 leader_election.cc:302] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 604b2928339948088c0ba554f75b84b0; no voters:
I20260807 02:17:04.547145 5971 leader_election.cc:288] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:04.547243 5980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:04.547477 5980 raft_consensus.cc:686] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [term 1 LEADER]: Becoming Leader. State: Replica: 604b2928339948088c0ba554f75b84b0, State: Running, Role: LEADER
I20260807 02:17:04.547811 5980 consensus_queue.cc:237] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604b2928339948088c0ba554f75b84b0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36811 } }
I20260807 02:17:04.548249 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:04.534461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58152 (local address 127.1.126.254:36811)
0807 02:17:04.534914 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:04.534929 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:04.534963 (+ 34us) server_negotiation.cc:407] Connection header received
0807 02:17:04.535537 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:04.535552 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:04.535838 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:04.536144 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:04.537018 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:04.537984 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:04.539190 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:04.539728 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:04.539897 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:04.542694 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:04.542747 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:04.542767 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:04.542798 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:04.545223 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:04.545731 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:04.545735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:04.545739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:04.545839 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:04.546093 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:04.546095 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:04.546096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:04.546458 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:04.546770 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:04.547048 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 02:17:04.547368 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":143,"threads_started":1}
I20260807 02:17:04.548414 5971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:04.548962 5980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 604b2928339948088c0ba554f75b84b0. Latest consensus state: current_term: 1 leader_uuid: "604b2928339948088c0ba554f75b84b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604b2928339948088c0ba554f75b84b0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36811 } } }
I20260807 02:17:04.549737 5980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:04.549615 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "604b2928339948088c0ba554f75b84b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604b2928339948088c0ba554f75b84b0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36811 } } }
I20260807 02:17:04.550025 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:04.550695 5993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:04.553325 5993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:04.559352 5993 catalog_manager.cc:1347] Generated new cluster ID: 06a8a9f15f794dbb86273148a7f25b50
I20260807 02:17:04.559418 5993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:04.572930 5993 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:04.573899 5993 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:04.578351 5993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 604b2928339948088c0ba554f75b84b0: Generated new TSK 0
I20260807 02:17:04.579142 5993 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:04.609555 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36811
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:04.721855 6007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:04.722090 6007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:04.722137 6007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:04.726096 6007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:04.726159 6007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:04.726246 6007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:04.731416 6007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:04.732488 6007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:04.733551 6007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:04.743614 6017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:04.743609 6015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:04.743613 6013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:04.743698 6007 server_base.cc:1034] running on GCE node
I20260807 02:17:04.744366 6007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:04.745020 6007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:04.746210 6007 hybrid_clock.cc:648] HybridClock initialized: now 1786069024746168 us; error 53 us; skew 500 ppm
Aug 07 02:17:04 dist-test-slave-39l8 krb5kdc[5857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:04.748968 6007 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:04.749881 6007 webserver.cc:460] Webserver started at http://127.1.126.193:36421/ using document root <none> and password file <none>
I20260807 02:17:04.750465 6007 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:04.750557 6007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:04.750871 6007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:04.752926 6007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "161a32ac44fe446d89073564eec5b18c"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "ce5ad31a42f7048e92b7351df4d667f0"
server_key_iv: "66ad183bee49dc0df3f306da9054a67b"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.753511 6007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "161a32ac44fe446d89073564eec5b18c"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "ce5ad31a42f7048e92b7351df4d667f0"
server_key_iv: "66ad183bee49dc0df3f306da9054a67b"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.757131 6007 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:04.759581 6025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:04.760758 6007 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:04.760907 6007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "161a32ac44fe446d89073564eec5b18c"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "ce5ad31a42f7048e92b7351df4d667f0"
server_key_iv: "66ad183bee49dc0df3f306da9054a67b"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.761025 6007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:04.777738 6007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:04.780619 6007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:04.780845 6007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:04.781454 6007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:04.782325 6007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:04.782399 6007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:04.782473 6007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:04.782517 6007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:04.791743 6007 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:36007
I20260807 02:17:04.791769 6181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:36007 every 8 connection(s)
I20260807 02:17:04.792654 6007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:04.796265 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 6007
I20260807 02:17:04.796416 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:04.796778 1531 external_mini_cluster.cc:1428] Setting key e470f93068dd2ea4b89d1f37defc4dda
Aug 07 02:17:04 dist-test-slave-39l8 krb5kdc[5857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:17:04.808315 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:04.794574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:39497 (local address 127.1.126.254:36811)
0807 02:17:04.794747 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:04.794752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:04.795610 (+ 858us) server_negotiation.cc:407] Connection header received
0807 02:17:04.797470 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:04.797473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:04.797543 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:04.797631 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:04.799159 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:04.799678 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:04.801111 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:04.801508 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:04.801643 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:04.804335 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:04.804341 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:04.804346 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:04.804380 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:04.806119 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:04.806624 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:04.806628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:04.806630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:04.806755 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:04.807097 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:04.807102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:04.807106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:04.807373 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:04.807512 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:04.807971 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 02:17:04.808114 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:17:04.809121 6186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:04.795015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36811 (local address 127.1.126.193:39497)
0807 02:17:04.795462 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:04.795505 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:04.797235 (+ 1730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:04.797796 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:04.797803 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:04.798305 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:04.799005 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:04.799029 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:04.799806 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:04.799813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:04.800981 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:04.800992 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:04.801666 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:04.801669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:04.801801 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:04.802428 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:04.802443 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:04.804146 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:04.806251 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:04.806256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:04.806267 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:04.806507 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:04.806848 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:04.806850 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:04.806852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:04.806980 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:04.807497 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:04.807502 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:04.807722 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 02:17:04.807864 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 02:17:04.808165 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":113,"threads_started":1}
I20260807 02:17:04.810400 6182 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36811
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:17:04.810653 6182 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:04.811143 6182 heartbeater.cc:511] Master 127.1.126.254:36811 requested a full tablet report, sending...
I20260807 02:17:04.812861 5920 ts_manager.cc:194] Registered new tserver with Master: 161a32ac44fe446d89073564eec5b18c (127.1.126.193:36007)
I20260807 02:17:04.814589 5920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:39497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:04.825779 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36811
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:04.938391 6189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:04.938637 6189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:04.938678 6189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:04.942848 6189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:04.942899 6189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:04.942953 6189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:04.947969 6189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:04.948935 6189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:04.949945 6189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:04.959623 6194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:04.959769 6189 server_base.cc:1034] running on GCE node
W20260807 02:17:04.959687 6195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:04.959728 6199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:04.960271 6189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:04.960856 6189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:04.962044 6189 hybrid_clock.cc:648] HybridClock initialized: now 1786069024962026 us; error 29 us; skew 500 ppm
Aug 07 02:17:04 dist-test-slave-39l8 krb5kdc[5857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:04.964885 6189 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:04.965781 6189 webserver.cc:460] Webserver started at http://127.1.126.194:39401/ using document root <none> and password file <none>
I20260807 02:17:04.966338 6189 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:04.966430 6189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:04.966687 6189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:04.968727 6189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "8f3797c042f5496685a3cd355bbdcc76"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "3c6d11614dde3b1b108c777e9e8888cf"
server_key_iv: "059ef6ad618b47aeecfb6a0c1b5f14a5"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.969290 6189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "8f3797c042f5496685a3cd355bbdcc76"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "3c6d11614dde3b1b108c777e9e8888cf"
server_key_iv: "059ef6ad618b47aeecfb6a0c1b5f14a5"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.972961 6189 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:04.975256 6210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:04.976433 6189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:04.976583 6189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "8f3797c042f5496685a3cd355bbdcc76"
format_stamp: "Formatted at 2026-08-07 02:17:04 on dist-test-slave-39l8"
server_key: "3c6d11614dde3b1b108c777e9e8888cf"
server_key_iv: "059ef6ad618b47aeecfb6a0c1b5f14a5"
server_key_version: "encryptionkey@0"
I20260807 02:17:04.976706 6189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:04.989374 6189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:04.992246 6189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:04.992434 6189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:04.992973 6189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:04.993767 6189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:04.993847 6189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:04.993911 6189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:04.993950 6189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:05.002290 6189 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:45989
I20260807 02:17:05.002334 6370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:45989 every 8 connection(s)
I20260807 02:17:05.003252 6189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[5857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:05.012485 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 6189
I20260807 02:17:05.012619 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:05.012923 1531 external_mini_cluster.cc:1428] Setting key 16473b4b67f411313aa65d54b4a2a2e5
I20260807 02:17:05.016726 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:05.004978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58475 (local address 127.1.126.254:36811)
0807 02:17:05.005126 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:05.005131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:05.005941 (+ 810us) server_negotiation.cc:407] Connection header received
0807 02:17:05.007240 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:05.007243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:05.007291 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:05.007364 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:05.008459 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.009025 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.010098 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.010329 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.010407 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:05.012964 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:05.012968 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:05.012973 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:05.013023 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:05.014647 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:05.015221 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:05.015225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:05.015227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:05.015309 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:05.015674 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:05.015677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:05.015679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:05.015854 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:05.015964 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:05.016430 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 02:17:05.016550 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:17:05.017513 6375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:05.005363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36811 (local address 127.1.126.194:58475)
0807 02:17:05.005797 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:05.005837 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:05.007055 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:05.007521 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:05.007527 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:05.007880 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:05.008329 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:05.008341 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.009127 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.009130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:05.009995 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:05.010004 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.010456 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.010459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:05.010595 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:05.011200 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:05.011215 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:05.012800 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:05.014820 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:05.014826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:05.014839 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:05.015107 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:05.015412 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:05.015415 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:05.015417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:05.015556 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:05.015961 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:05.015967 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:05.016202 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 02:17:05.016385 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 02:17:05.016678 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":112,"threads_started":1}
I20260807 02:17:05.018633 6373 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36811
I20260807 02:17:05.018930 6373 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:05.019549 6373 heartbeater.cc:511] Master 127.1.126.254:36811 requested a full tablet report, sending...
I20260807 02:17:05.020673 5920 ts_manager.cc:194] Registered new tserver with Master: 8f3797c042f5496685a3cd355bbdcc76 (127.1.126.194:45989)
I20260807 02:17:05.021232 5920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:58475
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:05.041288 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36811
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:42187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:05.152531 6379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:05.152779 6379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:05.152858 6379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:05.156919 6379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:05.156975 6379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:05.157075 6379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:05.163403 6379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:05.164436 6379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:05.165514 6379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:05.174540 6387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:05.174695 6379 server_base.cc:1034] running on GCE node
W20260807 02:17:05.174922 6389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:05.174938 6384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:05.175414 6379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:05.175962 6379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:05.177125 6379 hybrid_clock.cc:648] HybridClock initialized: now 1786069025177105 us; error 26 us; skew 500 ppm
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[5857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069025, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:05.179877 6379 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:05.180819 6379 webserver.cc:460] Webserver started at http://127.1.126.195:43547/ using document root <none> and password file <none>
I20260807 02:17:05.181420 6379 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:05.181501 6379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:05.181756 6379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:05.183766 6379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "7da4b4d3522c4ee998da9cc61328721c"
format_stamp: "Formatted at 2026-08-07 02:17:05 on dist-test-slave-39l8"
server_key: "16eb666346ac49b154813b993b6eec50"
server_key_iv: "a4d6f24d26896e5e55285dccb6590dde"
server_key_version: "encryptionkey@0"
I20260807 02:17:05.184310 6379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "7da4b4d3522c4ee998da9cc61328721c"
format_stamp: "Formatted at 2026-08-07 02:17:05 on dist-test-slave-39l8"
server_key: "16eb666346ac49b154813b993b6eec50"
server_key_iv: "a4d6f24d26896e5e55285dccb6590dde"
server_key_version: "encryptionkey@0"
I20260807 02:17:05.187827 6379 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:05.190196 6399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:05.191428 6379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:05.191522 6379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "7da4b4d3522c4ee998da9cc61328721c"
format_stamp: "Formatted at 2026-08-07 02:17:05 on dist-test-slave-39l8"
server_key: "16eb666346ac49b154813b993b6eec50"
server_key_iv: "a4d6f24d26896e5e55285dccb6590dde"
server_key_version: "encryptionkey@0"
I20260807 02:17:05.191601 6379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:05.202781 6379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:05.205435 6379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:05.205574 6379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:05.206073 6379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:05.206875 6379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:05.206924 6379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:05.206964 6379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:05.206984 6379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:05.215675 6379 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:33089
I20260807 02:17:05.215693 6558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:33089 every 8 connection(s)
I20260807 02:17:05.216516 6379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:05.217110 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 6379
I20260807 02:17:05.217254 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:05.217532 1531 external_mini_cluster.cc:1428] Setting key 3cc14c496c86639b7eab11b31144c67a
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[5857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069025, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:05.230780 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:05.219247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:39969 (local address 127.1.126.254:36811)
0807 02:17:05.219388 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:05.219393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:05.220327 (+ 934us) server_negotiation.cc:407] Connection header received
0807 02:17:05.221693 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:05.221696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:05.221753 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:05.221850 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:05.223029 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.223559 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.224698 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.224928 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.225033 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:05.227458 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:05.227461 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:05.227463 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:05.227486 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:05.228692 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:05.229193 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:05.229199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:05.229201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:05.229279 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:05.229611 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:05.229615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:05.229617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:05.229798 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:05.229908 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:05.230443 (+ 535us) server_negotiation.cc:299] Negotiation successful
0807 02:17:05.230573 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:05.231669 6562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:05.219642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36811 (local address 127.1.126.195:39969)
0807 02:17:05.220186 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:05.220226 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:05.221492 (+ 1266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:05.222012 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:05.222018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:05.222346 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:05.222874 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:05.222888 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.223685 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.223689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:05.224569 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:05.224578 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.225076 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.225080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:05.225245 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:05.225838 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:05.225853 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:05.227295 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:05.228810 (+ 1515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:05.228815 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:05.228828 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:05.229080 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:05.229372 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:05.229376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:05.229377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:05.229510 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:05.229905 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:05.229911 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:05.230144 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 02:17:05.230357 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 02:17:05.230684 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":160,"threads_started":1}
I20260807 02:17:05.232744 6559 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36811
I20260807 02:17:05.232977 6559 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:05.233446 6559 heartbeater.cc:511] Master 127.1.126.254:36811 requested a full tablet report, sending...
I20260807 02:17:05.234453 5920 ts_manager.cc:194] Registered new tserver with Master: 7da4b4d3522c4ee998da9cc61328721c (127.1.126.195:33089)
I20260807 02:17:05.235059 5920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:39969
I20260807 02:17:05.243182 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[5857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069025, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[5857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069025, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:05.269891 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:05.261311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58158 (local address 127.1.126.254:36811)
0807 02:17:05.261462 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:05.261468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:05.261652 (+ 184us) server_negotiation.cc:407] Connection header received
0807 02:17:05.261816 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:05.261821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:05.261871 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:05.261958 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:05.262688 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.263251 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.264119 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:05.264335 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:05.264446 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:05.266995 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:05.266998 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:05.267000 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:05.267022 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:05.268211 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:05.268642 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:05.268645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:05.268646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:05.268727 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:05.269001 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:05.269005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:05.269006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:05.269226 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:05.269374 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:05.269602 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 02:17:05.269732 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 02:17:05.270300 5920 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58158
I20260807 02:17:05.271384 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 6007
I20260807 02:17:05.289475 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 6189
I20260807 02:17:05.300568 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 6379
I20260807 02:17:05.309587 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 5878
2026-08-07T02:17:05Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2296 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[6576](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[6576](info): set up 2 sockets
Aug 07 02:17:05 dist-test-slave-39l8 krb5kdc[6576](info): commencing operation
krb5kdc: starting...
W20260807 02:17:06.505496 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:06 dist-test-slave-39l8 krb5kdc[6576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:06.631450 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:34259
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:34259
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:06.741698 6590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:06.741958 6590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:06.741998 6590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:06.745896 6590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:06.745949 6590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:06.745966 6590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:06.745982 6590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:06.745997 6590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:06.751026 6590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:34259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:06.751942 6590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:06.752904 6590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:06.761369 6600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:06.761433 6590 server_base.cc:1034] running on GCE node
W20260807 02:17:06.761355 6595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:06.761363 6597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:06.762262 6590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:06.763362 6590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:06.764552 6590 hybrid_clock.cc:648] HybridClock initialized: now 1786069026764538 us; error 25 us; skew 500 ppm
Aug 07 02:17:06 dist-test-slave-39l8 krb5kdc[6576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069026, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:06.767266 6590 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:06.768119 6590 webserver.cc:460] Webserver started at http://127.1.126.254:43787/ using document root <none> and password file <none>
I20260807 02:17:06.768627 6590 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:06.768693 6590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:06.768850 6590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:06.770797 6590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "54eed9ffd98d4253a6fd6614329b1dfa"
format_stamp: "Formatted at 2026-08-07 02:17:06 on dist-test-slave-39l8"
server_key: "c67650b147c4ec7b9c6b1484940dd1b5"
server_key_iv: "f3bd55f45035130d3d645d56101a081c"
server_key_version: "encryptionkey@0"
I20260807 02:17:06.771313 6590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "54eed9ffd98d4253a6fd6614329b1dfa"
format_stamp: "Formatted at 2026-08-07 02:17:06 on dist-test-slave-39l8"
server_key: "c67650b147c4ec7b9c6b1484940dd1b5"
server_key_iv: "f3bd55f45035130d3d645d56101a081c"
server_key_version: "encryptionkey@0"
I20260807 02:17:06.774799 6590 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 02:17:06.776999 6607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:06.778220 6590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:06.778330 6590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "54eed9ffd98d4253a6fd6614329b1dfa"
format_stamp: "Formatted at 2026-08-07 02:17:06 on dist-test-slave-39l8"
server_key: "c67650b147c4ec7b9c6b1484940dd1b5"
server_key_iv: "f3bd55f45035130d3d645d56101a081c"
server_key_version: "encryptionkey@0"
I20260807 02:17:06.778411 6590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:06.790865 6590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:06.793435 6590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:06.793589 6590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:06.800756 6590 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:34259
I20260807 02:17:06.800787 6686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:34259 every 8 connection(s)
I20260807 02:17:06.801941 6590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:06.804764 6687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:06.808254 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 6590
I20260807 02:17:06.808384 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:06.808646 1531 external_mini_cluster.cc:1428] Setting key ec5c7a9b6deec651b6413eaebe27fb9f
I20260807 02:17:06.810758 6687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa: Bootstrap starting.
I20260807 02:17:06.813490 6687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:06.814325 6687 log.cc:824] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:06.816560 6687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa: No bootstrap required, opened a new log
Aug 07 02:17:06 dist-test-slave-39l8 krb5kdc[6576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:06.821192 6687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34259 } }
I20260807 02:17:06.821455 6687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:06.821547 6687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eed9ffd98d4253a6fd6614329b1dfa, State: Initialized, Role: FOLLOWER
I20260807 02:17:06.822021 6687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34259 } }
I20260807 02:17:06.822194 6687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:06.822266 6687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:06.822373 6687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:06.823344 6687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34259 } }
I20260807 02:17:06.823611 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:06.810038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.1.126.254:34259)
0807 02:17:06.810444 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:06.810463 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:06.810505 (+ 42us) server_negotiation.cc:407] Connection header received
0807 02:17:06.811333 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:06.811356 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:06.811749 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:06.812150 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:06.812778 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:06.814259 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:06.815128 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:06.815808 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:06.815977 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:06.818600 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:06.818606 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:06.818624 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:06.818655 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:06.820665 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:06.821080 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:06.821085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:06.821091 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:06.821245 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:06.821536 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:06.821541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:06.821545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:06.822026 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:06.822246 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:06.822574 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 02:17:06.822867 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":102,"threads_started":1}
I20260807 02:17:06.823729 6687 leader_election.cc:302] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54eed9ffd98d4253a6fd6614329b1dfa; no voters:
I20260807 02:17:06.824086 6687 leader_election.cc:288] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:06.824235 6692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:06.824478 6692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [term 1 LEADER]: Becoming Leader. State: Replica: 54eed9ffd98d4253a6fd6614329b1dfa, State: Running, Role: LEADER
I20260807 02:17:06.824815 6692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34259 } }
I20260807 02:17:06.825367 6687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:06.826741 6695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54eed9ffd98d4253a6fd6614329b1dfa. Latest consensus state: current_term: 1 leader_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34259 } } }
I20260807 02:17:06.826726 6694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eed9ffd98d4253a6fd6614329b1dfa" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34259 } } }
I20260807 02:17:06.826877 6694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:06.826877 6695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa [sys.catalog]: This master's current role is: LEADER
W20260807 02:17:06.830307 6713 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:17:06.830386 6713 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:17:06.830444 6705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:06.831338 6705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:06.836445 6705 catalog_manager.cc:1347] Generated new cluster ID: a62b052aa9f5475fbd049fdd51305d05
I20260807 02:17:06.836508 6705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:06.854308 6705 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:06.855247 6705 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:06.860496 6705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54eed9ffd98d4253a6fd6614329b1dfa: Generated new TSK 0
I20260807 02:17:06.861107 6705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:06.897112 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34259
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:07.023967 6721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:07.024189 6721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:07.024256 6721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:07.028910 6721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:07.028987 6721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:07.029090 6721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:07.034101 6721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:07.035192 6721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:07.036193 6721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:07.045617 6721 server_base.cc:1034] running on GCE node
W20260807 02:17:07.045581 6731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:07.045570 6728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:07.045730 6727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:07.046351 6721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:07.047051 6721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:07.048236 6721 hybrid_clock.cc:648] HybridClock initialized: now 1786069027048206 us; error 44 us; skew 500 ppm
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:07.050941 6721 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:07.051783 6721 webserver.cc:460] Webserver started at http://127.1.126.193:43027/ using document root <none> and password file <none>
I20260807 02:17:07.052348 6721 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:07.052443 6721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:07.052676 6721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:07.054682 6721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "ce0092567d7545dc985df607f88cfda4"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "791dc4954d7e5f3adda35f6b1df8b336"
server_key_iv: "9600fd2943fdd3af3d362b97022334dc"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.055336 6721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "ce0092567d7545dc985df607f88cfda4"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "791dc4954d7e5f3adda35f6b1df8b336"
server_key_iv: "9600fd2943fdd3af3d362b97022334dc"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.059068 6721 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:07.061448 6740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.062565 6721 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:07.062742 6721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "ce0092567d7545dc985df607f88cfda4"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "791dc4954d7e5f3adda35f6b1df8b336"
server_key_iv: "9600fd2943fdd3af3d362b97022334dc"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.062862 6721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:07.087926 6721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:07.090685 6721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:07.090945 6721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:07.091557 6721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:07.092448 6721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:07.092521 6721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.092599 6721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:07.092644 6721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.101763 6721 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:42283
I20260807 02:17:07.101790 6888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:42283 every 8 connection(s)
I20260807 02:17:07.102660 6721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:07.104938 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 6721
I20260807 02:17:07.105074 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:07.105404 1531 external_mini_cluster.cc:1428] Setting key 5337eebf67547510f789754137d2991c
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:17:07.117961 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.104555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:44809 (local address 127.1.126.254:34259)
0807 02:17:07.104739 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:07.104745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:07.105612 (+ 867us) server_negotiation.cc:407] Connection header received
0807 02:17:07.107104 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:07.107108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:07.107161 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:07.107259 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:07.108384 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.109229 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.110982 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.111403 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.111525 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.114021 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:07.114029 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:07.114034 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:07.114071 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:07.115856 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.116371 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.116377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.116381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.116477 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.116801 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.116807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.116811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.117068 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:07.117179 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:07.117639 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 02:17:07.117798 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 02:17:07.118785 6893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.104891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34259 (local address 127.1.126.193:44809)
0807 02:17:07.105441 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:07.105492 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:07.106900 (+ 1408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:07.107412 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:07.107418 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:07.107768 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:07.108233 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:07.108245 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.109367 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.109374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:07.110856 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:07.110867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.111558 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.111561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:07.111704 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.112344 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:07.112359 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:07.113827 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:07.115978 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:07.115983 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:07.115994 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:07.116259 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:07.116575 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:07.116577 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:07.116578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:07.116705 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:07.117192 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:07.117197 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:07.117423 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 02:17:07.117580 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 02:17:07.117830 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":172,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:17:07.120146 6889 heartbeater.cc:347] Connected to a master server at 127.1.126.254:34259
I20260807 02:17:07.120405 6889 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:07.120891 6889 heartbeater.cc:511] Master 127.1.126.254:34259 requested a full tablet report, sending...
I20260807 02:17:07.122642 6628 ts_manager.cc:194] Registered new tserver with Master: ce0092567d7545dc985df607f88cfda4 (127.1.126.193:42283)
I20260807 02:17:07.123796 6628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:44809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:07.135085 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34259
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:07.247042 6900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:07.247280 6900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:07.247319 6900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:07.251176 6900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:07.251220 6900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:07.251273 6900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:07.256295 6900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:07.257220 6900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:07.258176 6900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:07.267599 6905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:07.267685 6907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:07.267657 6909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:07.267747 6900 server_base.cc:1034] running on GCE node
I20260807 02:17:07.268281 6900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:07.269002 6900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:07.270166 6900 hybrid_clock.cc:648] HybridClock initialized: now 1786069027270147 us; error 33 us; skew 500 ppm
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:07.272995 6900 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:07.273777 6900 webserver.cc:460] Webserver started at http://127.1.126.194:36583/ using document root <none> and password file <none>
I20260807 02:17:07.274284 6900 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:07.274340 6900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:07.274497 6900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:07.276571 6900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "5213b06b5e9d40eeb13801f848a1d4c8"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "c68fc0894ab578ec5a7a25d76022301e"
server_key_iv: "232a7d3103f655936669e6fc9dfca33a"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.277137 6900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "5213b06b5e9d40eeb13801f848a1d4c8"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "c68fc0894ab578ec5a7a25d76022301e"
server_key_iv: "232a7d3103f655936669e6fc9dfca33a"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.280664 6900 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:07.283288 6918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.284492 6900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:07.284629 6900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "5213b06b5e9d40eeb13801f848a1d4c8"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "c68fc0894ab578ec5a7a25d76022301e"
server_key_iv: "232a7d3103f655936669e6fc9dfca33a"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.284739 6900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:07.305493 6900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:07.308691 6900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:07.308912 6900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:07.309551 6900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:07.310458 6900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:07.310531 6900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.310607 6900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:07.310652 6900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.320245 6900 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:39265
I20260807 02:17:07.320269 7078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:39265 every 8 connection(s)
I20260807 02:17:07.321193 6900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:07.322008 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 6900
I20260807 02:17:07.322150 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:07.322503 1531 external_mini_cluster.cc:1428] Setting key eca5eaa3609f52c670500ffd4a081a34
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
I20260807 02:17:07.337347 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.323288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:48447 (local address 127.1.126.254:34259)
0807 02:17:07.323471 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:07.323477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:07.324580 (+ 1103us) server_negotiation.cc:407] Connection header received
0807 02:17:07.326840 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:07.326846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:07.326919 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:07.327009 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:07.328376 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.328933 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.330079 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.330317 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.330428 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.333262 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:07.333266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:07.333268 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:07.333294 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:07.334899 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.335461 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.335465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.335466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.335583 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.335947 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.335953 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.335958 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.336162 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:07.336289 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:07.336923 (+ 634us) server_negotiation.cc:299] Negotiation successful
0807 02:17:07.337071 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 02:17:07.338078 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.323831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34259 (local address 127.1.126.194:48447)
0807 02:17:07.324396 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:07.324461 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:07.326518 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:07.327166 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:07.327172 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:07.327615 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:07.328235 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:07.328250 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.329066 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.329070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:07.329946 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:07.329955 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.330485 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.330489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:07.330664 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.331360 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:07.331378 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:07.333051 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:07.335027 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:07.335033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:07.335048 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:07.335307 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:07.335696 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:07.335699 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:07.335701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:07.335844 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:07.336336 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:07.336346 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:07.336664 (+ 318us) client_negotiation.cc:769] Sending connection context
0807 02:17:07.336839 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 02:17:07.337103 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":127,"threads_started":1}
I20260807 02:17:07.339447 7080 heartbeater.cc:347] Connected to a master server at 127.1.126.254:34259
I20260807 02:17:07.339717 7080 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:07.340245 7080 heartbeater.cc:511] Master 127.1.126.254:34259 requested a full tablet report, sending...
I20260807 02:17:07.341432 6628 ts_manager.cc:194] Registered new tserver with Master: 5213b06b5e9d40eeb13801f848a1d4c8 (127.1.126.194:39265)
I20260807 02:17:07.342020 6628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:48447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:07.353091 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34259
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:07.465169 7088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:07.465399 7088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:07.465440 7088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:07.469553 7088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:07.469609 7088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:07.469713 7088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:07.474786 7088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:07.475780 7088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:07.476742 7088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:07.487092 7093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:07.487176 7094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:07.487109 7097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:07.487438 7088 server_base.cc:1034] running on GCE node
I20260807 02:17:07.487834 7088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:07.488377 7088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:07.489527 7088 hybrid_clock.cc:648] HybridClock initialized: now 1786069027489501 us; error 37 us; skew 500 ppm
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:07.492293 7088 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:07.493076 7088 webserver.cc:460] Webserver started at http://127.1.126.195:46701/ using document root <none> and password file <none>
I20260807 02:17:07.493643 7088 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:07.493736 7088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:07.493964 7088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:07.495981 7088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "48ab8ed17bda4ff6a6331b9377547f6c"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "43480cb87f5f0619df295da3d2d4aa78"
server_key_iv: "fc5e4fd31a2d6d2ee38144d978c12272"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.496537 7088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "48ab8ed17bda4ff6a6331b9377547f6c"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "43480cb87f5f0619df295da3d2d4aa78"
server_key_iv: "fc5e4fd31a2d6d2ee38144d978c12272"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.500334 7088 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 02:17:07.502665 7107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.503831 7088 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:07.503969 7088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "48ab8ed17bda4ff6a6331b9377547f6c"
format_stamp: "Formatted at 2026-08-07 02:17:07 on dist-test-slave-39l8"
server_key: "43480cb87f5f0619df295da3d2d4aa78"
server_key_iv: "fc5e4fd31a2d6d2ee38144d978c12272"
server_key_version: "encryptionkey@0"
I20260807 02:17:07.504076 7088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:07.524645 7088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:07.528038 7088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:07.528254 7088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:07.528836 7088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:07.529661 7088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:07.529731 7088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.529800 7088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:07.529850 7088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:07.538676 7088 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:38745
I20260807 02:17:07.538697 7268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:38745 every 8 connection(s)
I20260807 02:17:07.539609 7088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:07.539915 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 7088
I20260807 02:17:07.540061 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:07.540418 1531 external_mini_cluster.cc:1428] Setting key 6962269255752c33f5037789f8fe8052
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:07.552901 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.541590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:36075 (local address 127.1.126.254:34259)
0807 02:17:07.541746 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:07.541767 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:07.542759 (+ 992us) server_negotiation.cc:407] Connection header received
0807 02:17:07.544221 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:07.544223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:07.544268 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:07.544336 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:07.545436 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.545953 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.547091 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.547305 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.547385 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.549662 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:07.549670 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:07.549672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:07.549695 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:07.551182 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.551619 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.551621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.551622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.551704 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.551988 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.551991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.551992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.552167 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:07.552242 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:07.552664 (+ 422us) server_negotiation.cc:299] Negotiation successful
0807 02:17:07.552762 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:17:07.553781 7272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.542114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34259 (local address 127.1.126.195:36075)
0807 02:17:07.542588 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:07.542641 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:07.544020 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:07.544497 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:07.544503 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:07.544837 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:07.545310 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:07.545323 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.546051 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.546054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:07.546982 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:07.546991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.547431 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.547433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:07.547566 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.548078 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:07.548093 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:07.549513 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:07.551281 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:07.551285 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:07.551297 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:07.551533 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:07.551784 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:07.551786 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:07.551787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:07.551909 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:07.552257 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:07.552262 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:07.552470 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 02:17:07.552625 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 02:17:07.552890 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":136,"threads_started":1}
I20260807 02:17:07.554992 7270 heartbeater.cc:347] Connected to a master server at 127.1.126.254:34259
I20260807 02:17:07.555234 7270 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:07.555742 7270 heartbeater.cc:511] Master 127.1.126.254:34259 requested a full tablet report, sending...
I20260807 02:17:07.556715 6625 ts_manager.cc:194] Registered new tserver with Master: 48ab8ed17bda4ff6a6331b9377547f6c (127.1.126.195:38745)
I20260807 02:17:07.557255 6625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:36075
I20260807 02:17:07.566334 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:17:07.593377 7279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.584167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42368 (local address 127.1.126.193:42283)
0807 02:17:07.584475 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:07.584490 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:07.584515 (+ 25us) server_negotiation.cc:407] Connection header received
0807 02:17:07.584620 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:07.584626 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:07.584822 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:07.584945 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:07.585577 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.586312 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.587127 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.587473 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.587554 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.589949 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:07.589958 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:07.589970 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:07.589993 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:07.591529 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.591978 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.591984 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.591985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.592095 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.592389 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.592393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.592394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.592635 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:07.592875 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:07.593043 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 02:17:07.593208 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":91,"threads_started":1}
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[6576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:07.604285 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:07.596276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34220 (local address 127.1.126.254:34259)
0807 02:17:07.596414 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:07.596419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:07.596461 (+ 42us) server_negotiation.cc:407] Connection header received
0807 02:17:07.596630 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:07.596632 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:07.596674 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:07.596757 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:07.597353 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.597962 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.598698 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:07.598920 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:07.599022 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:07.601245 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:07.601249 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:07.601251 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:07.601272 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:07.602644 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.603075 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.603078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.603080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.603158 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:07.603430 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:07.603433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:07.603435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:07.603666 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:07.603801 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:07.603993 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 02:17:07.604100 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 02:17:07.604688 6625 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34220
I20260807 02:17:07.605317 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 6721
I20260807 02:17:07.618474 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 6900
I20260807 02:17:07.626493 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 7088
I20260807 02:17:07.635499 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 6590
2026-08-07T02:17:07Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2326 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[7284](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[7284](info): set up 2 sockets
Aug 07 02:17:07 dist-test-slave-39l8 krb5kdc[7284](info): commencing operation
krb5kdc: starting...
W20260807 02:17:08.828851 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:08 dist-test-slave-39l8 krb5kdc[7284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:08.949891 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46141
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:45715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:46141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:09.060242 7307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:09.060516 7307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:09.060596 7307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:09.064477 7307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:09.064558 7307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:09.064596 7307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:09.064656 7307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:09.064713 7307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:09.069875 7307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:46141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:09.070956 7307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:09.071964 7307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:09.080101 7314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:09.080125 7316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:09.080199 7307 server_base.cc:1034] running on GCE node
W20260807 02:17:09.080137 7313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:09.080967 7307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:09.082022 7307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:09.083187 7307 hybrid_clock.cc:648] HybridClock initialized: now 1786069029083170 us; error 30 us; skew 500 ppm
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:09.085841 7307 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:09.086621 7307 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:09.086685 7307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:09.086915 7307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:09.088869 7307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "9febea9949dc44a8bd5e2240824258a6"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "27382064c6457f63b658cb64a201d390"
server_key_iv: "e647f6121193ea506c7d0cee433bfae6"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.089359 7307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "9febea9949dc44a8bd5e2240824258a6"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "27382064c6457f63b658cb64a201d390"
server_key_iv: "e647f6121193ea506c7d0cee433bfae6"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.092896 7307 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:09.095223 7323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.096514 7307 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:09.096619 7307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "9febea9949dc44a8bd5e2240824258a6"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "27382064c6457f63b658cb64a201d390"
server_key_iv: "e647f6121193ea506c7d0cee433bfae6"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.096706 7307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:09.136592 7307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:09.139643 7307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:09.139812 7307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:09.147166 7307 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:46141
I20260807 02:17:09.147454 7391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:46141 every 8 connection(s)
I20260807 02:17:09.147902 7307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:09.150792 7392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:09.156466 7392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6: Bootstrap starting.
I20260807 02:17:09.156781 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 7307
I20260807 02:17:09.156927 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:09.157195 1531 external_mini_cluster.cc:1428] Setting key 0d120a4eec6f55499c72e14e882bf9ba
I20260807 02:17:09.159282 7392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:09.160043 7392 log.cc:824] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:09.162287 7392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6: No bootstrap required, opened a new log
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:09.166127 7392 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9febea9949dc44a8bd5e2240824258a6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46141 } }
I20260807 02:17:09.166450 7392 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:09.166532 7392 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9febea9949dc44a8bd5e2240824258a6, State: Initialized, Role: FOLLOWER
I20260807 02:17:09.167091 7392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9febea9949dc44a8bd5e2240824258a6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46141 } }
I20260807 02:17:09.167245 7392 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:09.167313 7392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:09.167412 7392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:09.168751 7392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9febea9949dc44a8bd5e2240824258a6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46141 } }
I20260807 02:17:09.169263 7392 leader_election.cc:302] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9febea9949dc44a8bd5e2240824258a6; no voters:
I20260807 02:17:09.169736 7392 leader_election.cc:288] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:09.169870 7399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:09.170125 7399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [term 1 LEADER]: Becoming Leader. State: Replica: 9febea9949dc44a8bd5e2240824258a6, State: Running, Role: LEADER
I20260807 02:17:09.170498 7399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9febea9949dc44a8bd5e2240824258a6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46141 } }
I20260807 02:17:09.171252 7392 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:09.172462 7401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9febea9949dc44a8bd5e2240824258a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9febea9949dc44a8bd5e2240824258a6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46141 } } }
I20260807 02:17:09.172452 7402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9febea9949dc44a8bd5e2240824258a6. Latest consensus state: current_term: 1 leader_uuid: "9febea9949dc44a8bd5e2240824258a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9febea9949dc44a8bd5e2240824258a6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46141 } } }
I20260807 02:17:09.172606 7401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:09.172606 7402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:09.172892 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.158523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33404 (local address 127.1.126.254:46141)
0807 02:17:09.159002 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.159023 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.159060 (+ 37us) server_negotiation.cc:407] Connection header received
0807 02:17:09.159761 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.159781 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.160118 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.160521 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:09.161433 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.162533 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.163478 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.163962 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.164147 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.166932 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:09.166937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:09.166951 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:09.166981 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:09.169083 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.169732 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.169739 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.169747 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.169904 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.170304 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.170307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.170308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.170881 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:09.171201 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.171387 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.171729 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":152,"threads_started":1}
I20260807 02:17:09.173187 7414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:09.177366 7414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:09.183423 7414 catalog_manager.cc:1347] Generated new cluster ID: f4816d8736ef42038049a2e8793c8fc9
I20260807 02:17:09.183559 7414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:09.190099 7414 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:09.191425 7414 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:09.199138 7414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6: Generated new TSK 0
I20260807 02:17:09.199947 7414 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:09.235906 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46141
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:45715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:09.355309 7428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:09.355620 7428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:09.355669 7428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:09.359876 7428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:09.359948 7428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:09.360009 7428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:09.365607 7428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:09.366840 7428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:09.367969 7428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:09.377877 7436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:09.377998 7428 server_base.cc:1034] running on GCE node
W20260807 02:17:09.377839 7438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:09.377839 7435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:09.378608 7428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:09.379276 7428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:09.380482 7428 hybrid_clock.cc:648] HybridClock initialized: now 1786069029380433 us; error 45 us; skew 500 ppm
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:09.383337 7428 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:09.384066 7428 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:09.384130 7428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:09.384312 7428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:09.386287 7428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "bc3b85c66e4842edb54a97d0b229f2da"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "bd71e44c5c7ad0108f0e12a3a6c431e8"
server_key_iv: "aadb29d8ae8e4fbcd414141cb9911c64"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.386895 7428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "bc3b85c66e4842edb54a97d0b229f2da"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "bd71e44c5c7ad0108f0e12a3a6c431e8"
server_key_iv: "aadb29d8ae8e4fbcd414141cb9911c64"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.390652 7428 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260807 02:17:09.393251 7447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.394569 7428 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:09.394704 7428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "bc3b85c66e4842edb54a97d0b229f2da"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "bd71e44c5c7ad0108f0e12a3a6c431e8"
server_key_iv: "aadb29d8ae8e4fbcd414141cb9911c64"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.394852 7428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:09.419863 7428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:09.423346 7428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:09.423513 7428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:09.424139 7428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:09.425033 7428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:09.425113 7428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.425215 7428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:09.425277 7428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.434085 7428 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:42649
I20260807 02:17:09.434185 7606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:42649 every 8 connection(s)
I20260807 02:17:09.434818 7428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:09.444095 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 7428
I20260807 02:17:09.444269 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:09.444571 1531 external_mini_cluster.cc:1428] Setting key 975bce667650fa3aa52438898cee1bc2
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:09.449019 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.436742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:55753 (local address 127.1.126.254:46141)
0807 02:17:09.436896 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.436899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.437726 (+ 827us) server_negotiation.cc:407] Connection header received
0807 02:17:09.439227 (+ 1501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.439231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.439295 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.439401 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:09.440592 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.441129 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.442277 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.442527 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.442645 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.445335 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:09.445339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:09.445342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:09.445376 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:09.446917 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.447469 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.447473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.447475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.447563 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.447915 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.447920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.447921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.448104 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:09.448212 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.448719 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.448843 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:17:09.449843 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.437123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46141 (local address 127.1.126.193:55753)
0807 02:17:09.437574 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:09.437616 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:09.438996 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:09.439577 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:09.439584 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:09.439931 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:09.440424 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.440438 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.441260 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.441263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.442141 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.442150 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.442699 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.442749 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.442908 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.443538 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:09.443556 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:09.445161 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:09.447075 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:09.447082 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:09.447098 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:09.447358 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:09.447659 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:09.447663 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:09.447665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:09.447816 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:09.448214 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:09.448223 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:09.448478 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 02:17:09.448676 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 02:17:09.449006 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":100,"threads_started":1}
I20260807 02:17:09.451253 7608 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46141
I20260807 02:17:09.451548 7608 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:09.452173 7608 heartbeater.cc:511] Master 127.1.126.254:46141 requested a full tablet report, sending...
I20260807 02:17:09.454101 7342 ts_manager.cc:194] Registered new tserver with Master: bc3b85c66e4842edb54a97d0b229f2da (127.1.126.193:42649)
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:17:09.455871 7342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:55753
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:09.475647 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46141
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:45715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:09.595300 7615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:09.595561 7615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:09.595606 7615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:09.599678 7615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:09.599736 7615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:09.599798 7615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:09.605406 7615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:09.606518 7615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:09.607604 7615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:09.617178 7622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:09.617081 7625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:09.617065 7621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:09.617559 7615 server_base.cc:1034] running on GCE node
I20260807 02:17:09.617969 7615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:09.618654 7615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:09.619865 7615 hybrid_clock.cc:648] HybridClock initialized: now 1786069029619851 us; error 26 us; skew 500 ppm
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:09.629652 7615 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:09.630461 7615 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:09.630569 7615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:09.630872 7615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:09.633033 7615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "cbf156d6a94e4068bd1e895952013933"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "0bcde14369a2e897f25daa3cc8de07a9"
server_key_iv: "4a72e7b747010f3fb6d457b7aa288234"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.633615 7615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "cbf156d6a94e4068bd1e895952013933"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "0bcde14369a2e897f25daa3cc8de07a9"
server_key_iv: "4a72e7b747010f3fb6d457b7aa288234"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.637363 7615 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:09.639818 7636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.641055 7615 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:09.641211 7615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "cbf156d6a94e4068bd1e895952013933"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "0bcde14369a2e897f25daa3cc8de07a9"
server_key_iv: "4a72e7b747010f3fb6d457b7aa288234"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.641325 7615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:09.666605 7615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:09.669622 7615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:09.669840 7615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:09.670475 7615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:09.671463 7615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:09.671547 7615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.671625 7615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:09.671655 7615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.681118 7615 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:38197
I20260807 02:17:09.681135 7801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:38197 every 8 connection(s)
I20260807 02:17:09.681730 7615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:09.683521 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 7615
I20260807 02:17:09.683650 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:09.683962 1531 external_mini_cluster.cc:1428] Setting key 21e7cb694388c2bdd8778016e2f42d83
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:17:09.696712 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.683634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:59881 (local address 127.1.126.254:46141)
0807 02:17:09.683768 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.683772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.684880 (+ 1108us) server_negotiation.cc:407] Connection header received
0807 02:17:09.686404 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.686408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.686462 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.686546 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:09.687876 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.688403 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.689775 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.689984 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.690062 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.693046 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:09.693049 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:09.693051 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:09.693073 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:09.694530 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.695122 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.695126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.695130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.695215 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.695574 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.695578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.695580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.695768 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:09.695883 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.696395 (+ 512us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.696519 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:17:09.697564 7804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.684120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46141 (local address 127.1.126.194:59881)
0807 02:17:09.684705 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:09.684768 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:09.686197 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:09.686782 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:09.686790 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:09.687142 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:09.687709 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.687732 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.688537 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.688544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.689658 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.689675 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.690133 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.690140 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.690389 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.691095 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:09.691121 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:09.692872 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:09.694696 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:09.694728 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:09.694744 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:09.695009 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:09.695316 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:09.695319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:09.695321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:09.695467 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:09.695882 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:09.695889 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:09.696141 (+ 252us) client_negotiation.cc:769] Sending connection context
0807 02:17:09.696331 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 02:17:09.696661 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":161,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
I20260807 02:17:09.698961 7802 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46141
I20260807 02:17:09.699259 7802 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:09.699921 7802 heartbeater.cc:511] Master 127.1.126.254:46141 requested a full tablet report, sending...
I20260807 02:17:09.701222 7342 ts_manager.cc:194] Registered new tserver with Master: cbf156d6a94e4068bd1e895952013933 (127.1.126.194:38197)
I20260807 02:17:09.702167 7342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:59881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:09.715888 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46141
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:45715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:09.828779 7809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:09.828994 7809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:09.829034 7809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:09.832967 7809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:09.833017 7809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:09.833107 7809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:09.838086 7809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:09.839071 7809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:09.840030 7809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:09.849385 7820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:09.849385 7819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:09.849378 7822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:09.849637 7809 server_base.cc:1034] running on GCE node
I20260807 02:17:09.850083 7809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:09.850620 7809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:09.851780 7809 hybrid_clock.cc:648] HybridClock initialized: now 1786069029851768 us; error 24 us; skew 500 ppm
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:09.854436 7809 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:09.855194 7809 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:09.855260 7809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:09.855468 7809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:09.857439 7809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "63e9c26e4f7e4b57a27b82ab26d7588a"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "94e2e9fa806282d778d84d500f5eff31"
server_key_iv: "66b934af280de49375cc17da0aca397e"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.858003 7809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "63e9c26e4f7e4b57a27b82ab26d7588a"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "94e2e9fa806282d778d84d500f5eff31"
server_key_iv: "66b934af280de49375cc17da0aca397e"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.861519 7809 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:09.863900 7830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.865046 7809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:09.865167 7809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "63e9c26e4f7e4b57a27b82ab26d7588a"
format_stamp: "Formatted at 2026-08-07 02:17:09 on dist-test-slave-39l8"
server_key: "94e2e9fa806282d778d84d500f5eff31"
server_key_iv: "66b934af280de49375cc17da0aca397e"
server_key_version: "encryptionkey@0"
I20260807 02:17:09.865265 7809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:09.874282 7809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:09.876950 7809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:09.877139 7809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:09.877686 7809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:09.878485 7809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:09.878532 7809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.878597 7809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:09.878638 7809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:09.886905 7809 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:42421
I20260807 02:17:09.886925 7985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:42421 every 8 connection(s)
I20260807 02:17:09.887466 7809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:09.892503 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 7809
I20260807 02:17:09.892625 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:09.892966 1531 external_mini_cluster.cc:1428] Setting key bec8c3d0aa48a8fd52f2677a2574d51b
Aug 07 02:17:09 dist-test-slave-39l8 krb5kdc[7284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069029, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:09.900939 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.889082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:40003 (local address 127.1.126.254:46141)
0807 02:17:09.889245 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.889250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.890028 (+ 778us) server_negotiation.cc:407] Connection header received
0807 02:17:09.891345 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.891348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.891396 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.891469 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:09.892809 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.893527 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.895109 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.895403 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.895480 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.897653 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:09.897656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:09.897658 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:09.897682 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:09.899097 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.899565 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.899568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.899571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.899661 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.899956 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.899958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.899959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.900155 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:09.900229 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.900719 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.900822 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:17:09.901692 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.889451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46141 (local address 127.1.126.195:40003)
0807 02:17:09.889886 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:09.889925 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:09.891153 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:09.891620 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:09.891626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:09.891973 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:09.892518 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.892531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.893690 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.893694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.894989 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.895001 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.895542 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.895545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.895683 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.896160 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:09.896178 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:09.897498 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:09.899206 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:09.899210 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:09.899221 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:09.899449 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:09.899749 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:09.899752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:09.899753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:09.899876 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:09.900245 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:09.900250 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:09.900475 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 02:17:09.900632 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 02:17:09.900865 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
I20260807 02:17:09.902875 7986 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46141
I20260807 02:17:09.903095 7986 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:09.903522 7986 heartbeater.cc:511] Master 127.1.126.254:46141 requested a full tablet report, sending...
I20260807 02:17:09.904513 7342 ts_manager.cc:194] Registered new tserver with Master: 63e9c26e4f7e4b57a27b82ab26d7588a (127.1.126.195:42421)
I20260807 02:17:09.905054 7342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:40003
I20260807 02:17:09.906883 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:17:09.915783 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.908696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33414 (local address 127.1.126.254:46141)
0807 02:17:09.908830 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.908836 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.909000 (+ 164us) server_negotiation.cc:407] Connection header received
0807 02:17:09.909158 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.909161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.909204 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.909281 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:09.909962 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.910464 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.911352 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.911565 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.911675 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.912936 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:09.912939 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:09.912942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:09.912970 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:09.914054 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.914487 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.914491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.914493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.914568 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:09.914904 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:09.914907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:09.914909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:09.915109 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:09.915255 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.915507 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.915623 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:17:09.918284 7342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:09.921164 7342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:09.934871 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.929198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:38197 (local address 127.0.0.1:60482)
0807 02:17:09.930116 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:09.930128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:09.930258 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:09.931019 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:09.931026 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:09.931069 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:09.931272 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.931278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.932311 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.932317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.933578 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.933588 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.934338 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.934341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.934444 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.934478 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 02:17:09.934585 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 02:17:09.934697 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"mutex_wait_us":127,"spinlock_wait_cycles":3072,"thread_start_us":88,"threads_started":1}
I20260807 02:17:09.934882 8011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.929744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.1.126.194:38197)
0807 02:17:09.930074 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.930086 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.930390 (+ 304us) server_negotiation.cc:407] Connection header received
0807 02:17:09.930459 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.930463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.930656 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.930829 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:09.931383 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.932177 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.933699 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.934213 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.934336 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.934478 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.934621 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.934737 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":105,"threads_started":1}
I20260807 02:17:09.935478 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.929076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:42649 (local address 127.0.0.1:40622)
0807 02:17:09.929673 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:09.929719 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:09.930292 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:09.931019 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:09.931026 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:09.931064 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:09.931271 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.931278 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.932822 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.932825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.933774 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.933785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.935104 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.935108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.935194 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.935218 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 02:17:09.935281 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 02:17:09.935344 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":133,"spinlock_wait_cycles":1408,"thread_start_us":75,"threads_started":1}
I20260807 02:17:09.935966 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.929232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.1.126.193:42649)
0807 02:17:09.929487 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.929494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.930227 (+ 733us) server_negotiation.cc:407] Connection header received
0807 02:17:09.930439 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.930445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.930656 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.930829 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:09.931435 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.932660 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.933899 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.934740 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.934836 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.935663 (+ 827us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.935716 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.935803 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":64,"threads_started":1}
I20260807 02:17:09.937512 7710 tablet_service.cc:1467] Processing CreateTablet for tablet 579b480ab8dc4184a881259933bc7aea (DEFAULT_TABLE table=test-table [id=79aa3d5a0e0744009dde27fc6a84af86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:09.938448 7710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 579b480ab8dc4184a881259933bc7aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:09.940261 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.929777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:42421 (local address 127.0.0.1:56666)
0807 02:17:09.930555 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:09.930570 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:09.930681 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:09.931110 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:09.931121 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:09.931141 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:09.931343 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.931351 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.932822 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.932825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.934884 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:09.934894 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.939874 (+ 4980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.939877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:09.939967 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.939988 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:17:09.940053 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 02:17:09.940122 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":934,"thread_start_us":96,"threads_started":1}
I20260807 02:17:09.940730 8015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:09.930195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56666 (local address 127.1.126.195:42421)
0807 02:17:09.930576 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:09.930607 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:09.930651 (+ 44us) server_negotiation.cc:407] Connection header received
0807 02:17:09.930837 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:09.930841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:09.930975 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:09.931131 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:09.931476 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.932660 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.935177 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:09.939549 (+ 4372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:09.939645 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:09.939771 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:09.940459 (+ 688us) server_negotiation.cc:299] Negotiation successful
0807 02:17:09.940584 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":121,"threads_started":1}
I20260807 02:17:09.941277 7518 tablet_service.cc:1467] Processing CreateTablet for tablet 579b480ab8dc4184a881259933bc7aea (DEFAULT_TABLE table=test-table [id=79aa3d5a0e0744009dde27fc6a84af86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:09.942312 7518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 579b480ab8dc4184a881259933bc7aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:09.942922 7898 tablet_service.cc:1467] Processing CreateTablet for tablet 579b480ab8dc4184a881259933bc7aea (DEFAULT_TABLE table=test-table [id=79aa3d5a0e0744009dde27fc6a84af86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:09.943706 7898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 579b480ab8dc4184a881259933bc7aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:09.945731 8016 tablet_bootstrap.cc:492] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Bootstrap starting.
I20260807 02:17:09.948208 8016 tablet_bootstrap.cc:654] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:09.949136 8017 tablet_bootstrap.cc:492] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: Bootstrap starting.
I20260807 02:17:09.949563 8016 log.cc:824] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:09.951073 8020 tablet_bootstrap.cc:492] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Bootstrap starting.
I20260807 02:17:09.951501 8017 tablet_bootstrap.cc:654] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:09.952324 8016 tablet_bootstrap.cc:492] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: No bootstrap required, opened a new log
I20260807 02:17:09.952347 8017 log.cc:824] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:09.952538 8016 ts_tablet_manager.cc:1397] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 02:17:09.953217 8020 tablet_bootstrap.cc:654] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:09.954237 8020 log.cc:824] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:09.954300 8017 tablet_bootstrap.cc:492] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: No bootstrap required, opened a new log
I20260807 02:17:09.954490 8017 ts_tablet_manager.cc:1397] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:17:09.955816 8020 tablet_bootstrap.cc:492] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: No bootstrap required, opened a new log
I20260807 02:17:09.956005 8020 ts_tablet_manager.cc:1397] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 02:17:09.956482 8016 raft_consensus.cc:348] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:09.956766 8016 raft_consensus.cc:374] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:09.956821 8016 raft_consensus.cc:729] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf156d6a94e4068bd1e895952013933, State: Initialized, Role: FOLLOWER
I20260807 02:17:09.957310 8016 consensus_queue.cc:260] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:09.958158 7802 heartbeater.cc:503] Master 127.1.126.254:46141 was elected leader, sending a full tablet report...
I20260807 02:17:09.958316 8016 ts_tablet_manager.cc:1428] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:17:09.958748 8017 raft_consensus.cc:348] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:09.958972 8017 raft_consensus.cc:374] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:09.959033 8017 raft_consensus.cc:729] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc3b85c66e4842edb54a97d0b229f2da, State: Initialized, Role: FOLLOWER
I20260807 02:17:09.959487 8017 consensus_queue.cc:260] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:09.960095 7608 heartbeater.cc:503] Master 127.1.126.254:46141 was elected leader, sending a full tablet report...
I20260807 02:17:09.960438 8017 ts_tablet_manager.cc:1428] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:17:09.960352 8020 raft_consensus.cc:348] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:09.960618 8020 raft_consensus.cc:374] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:09.960668 8020 raft_consensus.cc:729] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63e9c26e4f7e4b57a27b82ab26d7588a, State: Initialized, Role: FOLLOWER
I20260807 02:17:09.961112 8020 consensus_queue.cc:260] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:09.961706 7986 heartbeater.cc:503] Master 127.1.126.254:46141 was elected leader, sending a full tablet report...
I20260807 02:17:09.962060 8020 ts_tablet_manager.cc:1428] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:17:10.021572 8027 raft_consensus.cc:482] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:10.021803 8027 raft_consensus.cc:504] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:10.022976 8027 leader_election.cc:288] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc3b85c66e4842edb54a97d0b229f2da (127.1.126.193:42649), cbf156d6a94e4068bd1e895952013933 (127.1.126.194:38197)
I20260807 02:17:10.027007 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.023379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:53557 (local address 127.1.126.193:42649)
0807 02:17:10.023513 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.023517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.023900 (+ 383us) server_negotiation.cc:407] Connection header received
0807 02:17:10.024005 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.024008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.024061 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.024138 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:10.024472 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.025013 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.026051 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.026423 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.026545 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:10.026600 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.026789 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.026876 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:17:10.027043 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.023224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:38197 (local address 127.1.126.195:38963)
0807 02:17:10.023506 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.023525 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.023629 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.024079 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.024081 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.024094 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:10.024211 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:10.024217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.025087 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.025093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:10.025888 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:10.025897 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.026571 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.026575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:10.026694 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:10.026773 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.026850 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.026914 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187}
I20260807 02:17:10.027064 8028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.023224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:42649 (local address 127.1.126.195:53557)
0807 02:17:10.023775 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.023791 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.023913 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.024208 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.024211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.024225 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:10.024340 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:10.024346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.025136 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.025139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:10.025897 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:10.025905 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.026545 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.026548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:10.026650 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:10.026673 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.026773 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.026865 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":119,"thread_start_us":152,"threads_started":1}
I20260807 02:17:10.027086 8011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.023451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:38963 (local address 127.1.126.194:38197)
0807 02:17:10.023868 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.023872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.023887 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:10.023941 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.023947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.024001 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.024070 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:10.024315 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.024965 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.026019 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.026432 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.026568 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:10.026620 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.026879 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.026959 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 02:17:10.027930 7736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579b480ab8dc4184a881259933bc7aea" candidate_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf156d6a94e4068bd1e895952013933" is_pre_election: true
I20260807 02:17:10.028175 7542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579b480ab8dc4184a881259933bc7aea" candidate_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc3b85c66e4842edb54a97d0b229f2da" is_pre_election: true
I20260807 02:17:10.028258 7736 raft_consensus.cc:2454] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63e9c26e4f7e4b57a27b82ab26d7588a in term 0.
I20260807 02:17:10.028445 7542 raft_consensus.cc:2454] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63e9c26e4f7e4b57a27b82ab26d7588a in term 0.
I20260807 02:17:10.028815 7831 leader_election.cc:302] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63e9c26e4f7e4b57a27b82ab26d7588a, cbf156d6a94e4068bd1e895952013933; no voters:
I20260807 02:17:10.029155 8027 raft_consensus.cc:2781] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:10.029253 8027 raft_consensus.cc:482] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:10.029300 8027 raft_consensus.cc:3037] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:10.030355 8027 raft_consensus.cc:504] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:10.030689 8027 leader_election.cc:288] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [CANDIDATE]: Term 1 election: Requested vote from peers bc3b85c66e4842edb54a97d0b229f2da (127.1.126.193:42649), cbf156d6a94e4068bd1e895952013933 (127.1.126.194:38197)
I20260807 02:17:10.031070 7542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579b480ab8dc4184a881259933bc7aea" candidate_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc3b85c66e4842edb54a97d0b229f2da"
I20260807 02:17:10.031056 7736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579b480ab8dc4184a881259933bc7aea" candidate_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf156d6a94e4068bd1e895952013933"
I20260807 02:17:10.031185 7542 raft_consensus.cc:3037] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:10.031195 7736 raft_consensus.cc:3037] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:10.032534 7736 raft_consensus.cc:2454] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63e9c26e4f7e4b57a27b82ab26d7588a in term 1.
I20260807 02:17:10.032534 7542 raft_consensus.cc:2454] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63e9c26e4f7e4b57a27b82ab26d7588a in term 1.
I20260807 02:17:10.032856 7840 leader_election.cc:302] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63e9c26e4f7e4b57a27b82ab26d7588a, bc3b85c66e4842edb54a97d0b229f2da; no voters:
I20260807 02:17:10.033018 8027 raft_consensus.cc:2781] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:10.033262 8027 raft_consensus.cc:686] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 1 LEADER]: Becoming Leader. State: Replica: 63e9c26e4f7e4b57a27b82ab26d7588a, State: Running, Role: LEADER
I20260807 02:17:10.033591 8027 consensus_queue.cc:237] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } }
I20260807 02:17:10.036871 7342 catalog_manager.cc:5495] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a reported cstate change: term changed from 0 to 1, leader changed from <none> to 63e9c26e4f7e4b57a27b82ab26d7588a (127.1.126.195). New cstate: current_term: 1 leader_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63e9c26e4f7e4b57a27b82ab26d7588a" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 42421 } health_report { overall_health: HEALTHY } } }
I20260807 02:17:10.055840 8015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.052636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56676 (local address 127.1.126.195:42421)
0807 02:17:10.052761 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.052764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.052796 (+ 32us) server_negotiation.cc:407] Connection header received
0807 02:17:10.052857 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.052859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.052907 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.052986 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:10.053175 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.053645 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.054521 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:10.054776 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:10.054867 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:10.055131 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:10.055521 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:10.055609 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.055673 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.055720 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:17:10.061633 7542 raft_consensus.cc:1261] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 1 FOLLOWER]: Refusing update from remote peer 63e9c26e4f7e4b57a27b82ab26d7588a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:10.061625 7736 raft_consensus.cc:1261] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 1 FOLLOWER]: Refusing update from remote peer 63e9c26e4f7e4b57a27b82ab26d7588a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:10.062361 8027 consensus_queue.cc:1035] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf156d6a94e4068bd1e895952013933" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:10.062602 8029 consensus_queue.cc:1035] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc3b85c66e4842edb54a97d0b229f2da" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 42649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:10.071573 8036 mvcc.cc:205] Tried to move back new op lower bound from 7315738747125030912 to 7315738747020447744. Current Snapshot: MvccSnapshot[applied={T|T < 7315738747125030912}]
I20260807 02:17:10.079598 7340 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:10.079774 7340 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:10.082208 7340 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9febea9949dc44a8bd5e2240824258a6: Sending DeleteTablet for 3 replicas of tablet 579b480ab8dc4184a881259933bc7aea
I20260807 02:17:10.083015 7518 tablet_service.cc:1514] Processing DeleteTablet for tablet 579b480ab8dc4184a881259933bc7aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:10 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:40622
I20260807 02:17:10.083024 7898 tablet_service.cc:1514] Processing DeleteTablet for tablet 579b480ab8dc4184a881259933bc7aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:10 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:56666
I20260807 02:17:10.083559 8048 tablet_replica.cc:330] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da: stopping tablet replica
I20260807 02:17:10.083652 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 7428
I20260807 02:17:10.083643 7710 tablet_service.cc:1514] Processing DeleteTablet for tablet 579b480ab8dc4184a881259933bc7aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:10 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:60482
I20260807 02:17:10.083876 8048 raft_consensus.cc:2229] T 579b480ab8dc4184a881259933bc7aea P bc3b85c66e4842edb54a97d0b229f2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:10.089972 8049 tablet_replica.cc:330] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: stopping tablet replica
I20260807 02:17:10.090286 8049 raft_consensus.cc:2229] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:10.090694 8049 raft_consensus.cc:2258] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:10.097375 8049 ts_tablet_manager.cc:1905] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:10.101384 8049 ts_tablet_manager.cc:1918] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:10.101519 8049 log.cc:1196] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/579b480ab8dc4184a881259933bc7aea
I20260807 02:17:10.101918 8049 ts_tablet_manager.cc:1939] T 579b480ab8dc4184a881259933bc7aea P 63e9c26e4f7e4b57a27b82ab26d7588a: Deleting consensus metadata
I20260807 02:17:10.101933 8050 tablet_replica.cc:330] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: stopping tablet replica
I20260807 02:17:10.102250 8050 raft_consensus.cc:2229] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:10.102589 8050 raft_consensus.cc:2258] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:10.103523 7324 catalog_manager.cc:4841] TS 63e9c26e4f7e4b57a27b82ab26d7588a (127.1.126.195:42421): tablet 579b480ab8dc4184a881259933bc7aea (table test-table [id=79aa3d5a0e0744009dde27fc6a84af86]) successfully deleted
I20260807 02:17:10.104219 8050 ts_tablet_manager.cc:1905] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:10.106863 8050 ts_tablet_manager.cc:1918] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:10.106961 8050 log.cc:1196] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/579b480ab8dc4184a881259933bc7aea
I20260807 02:17:10.107301 8050 ts_tablet_manager.cc:1939] T 579b480ab8dc4184a881259933bc7aea P cbf156d6a94e4068bd1e895952013933: Deleting consensus metadata
I20260807 02:17:10.108557 7324 catalog_manager.cc:4841] TS cbf156d6a94e4068bd1e895952013933 (127.1.126.194:38197): tablet 579b480ab8dc4184a881259933bc7aea (table test-table [id=79aa3d5a0e0744009dde27fc6a84af86]) successfully deleted
W20260807 02:17:10.108670 7328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:42649 (error 108)
I20260807 02:17:10.109625 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 7615
I20260807 02:17:10.109838 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.109487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:42649 (local address 127.0.0.1:40630)
0807 02:17:10.109648 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.109734 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:42649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 02:17:10.112416 7328 catalog_manager.cc:4584] TS bc3b85c66e4842edb54a97d0b229f2da (127.1.126.193:42649): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 579b480ab8dc4184a881259933bc7aea: Network error: Client connection negotiation failed: client connection to 127.1.126.193:42649: connect: Connection refused (error 111)
I20260807 02:17:10.119160 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 7809
I20260807 02:17:10.128713 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 7307
2026-08-07T02:17:10Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2492 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T02:17:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:10Z Disabled control of system clock
I20260807 02:17:10.162964 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46073
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:46073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 02:17:10.274387 8058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:10.274612 8058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:10.274645 8058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:10.278534 8058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:10.278587 8058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:10.278602 8058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:10.278620 8058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:10.278635 8058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:10.283370 8058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:46073
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:10.284339 8058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:10.285578 8058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:10.294348 8070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:10.294389 8066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.294399 8058 server_base.cc:1034] running on GCE node
W20260807 02:17:10.294646 8067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.295192 8058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:10.296276 8058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:10.297464 8058 hybrid_clock.cc:648] HybridClock initialized: now 1786069030297442 us; error 48 us; skew 500 ppm
I20260807 02:17:10.299257 8058 webserver.cc:460] Webserver started at http://127.1.126.254:33085/ using document root <none> and password file <none>
I20260807 02:17:10.299821 8058 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:10.299914 8058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:10.300145 8058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:10.302115 8058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "be69d120a5644c8c9214366f7bfa300a"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "26ad628cdcc4b834c6670b064c3ec898"
server_key_iv: "ee955329afc3fd4ce2175ac25988d2ba"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.302743 8058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "be69d120a5644c8c9214366f7bfa300a"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "26ad628cdcc4b834c6670b064c3ec898"
server_key_iv: "ee955329afc3fd4ce2175ac25988d2ba"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.306355 8058 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:17:10.308746 8076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.309897 8058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:10.310050 8058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "be69d120a5644c8c9214366f7bfa300a"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "26ad628cdcc4b834c6670b064c3ec898"
server_key_iv: "ee955329afc3fd4ce2175ac25988d2ba"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.310161 8058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:10.314633 8058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:10.315227 8058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:10.315407 8058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:10.322145 8058 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:46073
I20260807 02:17:10.322165 8147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:46073 every 8 connection(s)
I20260807 02:17:10.323076 8058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:10.326393 8148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:10.328645 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 8058
I20260807 02:17:10.328773 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:10.329078 1531 external_mini_cluster.cc:1428] Setting key 0c8748a6f6ee921eec4d212c6614e2b2
I20260807 02:17:10.332906 8148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a: Bootstrap starting.
I20260807 02:17:10.334791 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.330541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33288 (local address 127.1.126.254:46073)
0807 02:17:10.331276 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.331296 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.331332 (+ 36us) server_negotiation.cc:407] Connection header received
0807 02:17:10.332144 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.332162 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.332510 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.332842 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.333589 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.333593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.333603 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.333611 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.333656 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.333671 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.333817 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.333886 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.334117 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":169,"threads_started":1}
I20260807 02:17:10.335551 8148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:10.336376 8148 log.cc:824] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:10.338284 8148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a: No bootstrap required, opened a new log
I20260807 02:17:10.341989 8148 raft_consensus.cc:348] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69d120a5644c8c9214366f7bfa300a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46073 } }
I20260807 02:17:10.342214 8148 raft_consensus.cc:374] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:10.342279 8148 raft_consensus.cc:729] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be69d120a5644c8c9214366f7bfa300a, State: Initialized, Role: FOLLOWER
I20260807 02:17:10.342746 8148 consensus_queue.cc:260] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69d120a5644c8c9214366f7bfa300a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46073 } }
I20260807 02:17:10.342903 8148 raft_consensus.cc:388] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:10.342967 8148 raft_consensus.cc:482] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:10.343057 8148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:10.343901 8148 raft_consensus.cc:504] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69d120a5644c8c9214366f7bfa300a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46073 } }
I20260807 02:17:10.344228 8148 leader_election.cc:302] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be69d120a5644c8c9214366f7bfa300a; no voters:
I20260807 02:17:10.344564 8148 leader_election.cc:288] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:10.344681 8155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:10.344904 8155 raft_consensus.cc:686] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [term 1 LEADER]: Becoming Leader. State: Replica: be69d120a5644c8c9214366f7bfa300a, State: Running, Role: LEADER
I20260807 02:17:10.345196 8155 consensus_queue.cc:237] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69d120a5644c8c9214366f7bfa300a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46073 } }
I20260807 02:17:10.345747 8148 sys_catalog.cc:564] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:10.346912 8157 sys_catalog.cc:455] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [sys.catalog]: SysCatalogTable state changed. Reason: New leader be69d120a5644c8c9214366f7bfa300a. Latest consensus state: current_term: 1 leader_uuid: "be69d120a5644c8c9214366f7bfa300a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69d120a5644c8c9214366f7bfa300a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46073 } } }
I20260807 02:17:10.347043 8157 sys_catalog.cc:458] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:10.347330 8156 sys_catalog.cc:455] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be69d120a5644c8c9214366f7bfa300a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69d120a5644c8c9214366f7bfa300a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46073 } } }
I20260807 02:17:10.347434 8156 sys_catalog.cc:458] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:10.348096 8167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:10.351179 8167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:10.356630 8167 catalog_manager.cc:1347] Generated new cluster ID: 21a3aad9347a4433adaacaca5664025b
I20260807 02:17:10.356711 8167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:10.377457 8167 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:10.377784 8167 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:10.384629 8167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a: Generated new TSK 0
I20260807 02:17:10.385246 8167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:10.394884 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46073
--builtin_ntp_servers=127.1.126.212:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 02:17:10.533381 8186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:10.533660 8186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:10.533725 8186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:10.537391 8186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:10.537434 8186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:10.537483 8186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:10.542038 8186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:10.543015 8186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:10.544363 8186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:10.554349 8186 server_base.cc:1034] running on GCE node
W20260807 02:17:10.554240 8192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:10.554240 8196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:10.554301 8193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.554976 8186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:10.555616 8186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:10.556809 8186 hybrid_clock.cc:648] HybridClock initialized: now 1786069030556793 us; error 26 us; skew 500 ppm
I20260807 02:17:10.558764 8186 webserver.cc:460] Webserver started at http://127.1.126.193:37155/ using document root <none> and password file <none>
I20260807 02:17:10.559374 8186 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:10.559470 8186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:10.559706 8186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:10.561766 8186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "ab57c81dd7064db6a2b81f242e3d0716"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "78a44ebfc0e43122611c60eecdb8f772"
server_key_iv: "3938eb6c2cc8ebd0405eff48f3ee2356"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.562330 8186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "ab57c81dd7064db6a2b81f242e3d0716"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "78a44ebfc0e43122611c60eecdb8f772"
server_key_iv: "3938eb6c2cc8ebd0405eff48f3ee2356"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.565927 8186 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.001s
I20260807 02:17:10.568379 8208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.569547 8186 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:10.569689 8186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "ab57c81dd7064db6a2b81f242e3d0716"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "78a44ebfc0e43122611c60eecdb8f772"
server_key_iv: "3938eb6c2cc8ebd0405eff48f3ee2356"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.569800 8186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:10.574339 8186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:10.575003 8186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:10.575184 8186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:10.575742 8186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:10.576658 8186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:10.576726 8186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.576793 8186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:10.576848 8186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.585665 8186 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:33461
I20260807 02:17:10.585702 8372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:33461 every 8 connection(s)
I20260807 02:17:10.586527 8186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:10.592501 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.588504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:57619 (local address 127.1.126.254:46073)
0807 02:17:10.588646 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.588649 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.589617 (+ 968us) server_negotiation.cc:407] Connection header received
0807 02:17:10.590908 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.590911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.590948 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.591023 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.592126 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.592128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.592130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.592139 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.592153 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.592159 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.592236 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.592362 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.592397 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:17:10.592842 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 8186
I20260807 02:17:10.592971 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:10.593276 1531 external_mini_cluster.cc:1428] Setting key 528e6495eace1b084b364ac4e792dd58
I20260807 02:17:10.593538 8375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.588849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46073 (local address 127.1.126.193:57619)
0807 02:17:10.589473 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.589513 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.590686 (+ 1173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.591189 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.591196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.591277 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:10.591877 (+ 600us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:10.591879 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:10.591918 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:10.591985 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:10.592240 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:10.592248 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:10.592252 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.592379 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.592582 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":109,"threads_started":1}
I20260807 02:17:10.594852 8373 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46073
I20260807 02:17:10.595098 8373 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:10.595395 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46073
--builtin_ntp_servers=127.1.126.212:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 02:17:10.595527 8373 heartbeater.cc:511] Master 127.1.126.254:46073 requested a full tablet report, sending...
I20260807 02:17:10.597213 8099 ts_manager.cc:194] Registered new tserver with Master: ab57c81dd7064db6a2b81f242e3d0716 (127.1.126.193:33461)
W20260807 02:17:10.705870 8376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:10.706100 8376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:10.706171 8376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:10.710058 8376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:10.710112 8376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:10.710192 8376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:10.714805 8376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:10.715765 8376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:10.717109 8376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:10.726519 8383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.726696 8376 server_base.cc:1034] running on GCE node
W20260807 02:17:10.726536 8386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:10.726557 8384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.727257 8376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:10.727870 8376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:10.729068 8376 hybrid_clock.cc:648] HybridClock initialized: now 1786069030729029 us; error 51 us; skew 500 ppm
I20260807 02:17:10.730894 8376 webserver.cc:460] Webserver started at http://127.1.126.194:35157/ using document root <none> and password file <none>
I20260807 02:17:10.731479 8376 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:10.731570 8376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:10.731791 8376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:10.733829 8376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "19ab40c1a6a54b33b72b17237c3daf1c"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "2ca5274172e5c78b793da734ed2cf3c3"
server_key_iv: "62f23b5660d09c57ce78cb0b625609f2"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.734390 8376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "19ab40c1a6a54b33b72b17237c3daf1c"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "2ca5274172e5c78b793da734ed2cf3c3"
server_key_iv: "62f23b5660d09c57ce78cb0b625609f2"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.737962 8376 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:10.740353 8393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.741571 8376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:10.741709 8376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "19ab40c1a6a54b33b72b17237c3daf1c"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "2ca5274172e5c78b793da734ed2cf3c3"
server_key_iv: "62f23b5660d09c57ce78cb0b625609f2"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.741819 8376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:10.746412 8376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:10.747135 8376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:10.747332 8376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:10.747900 8376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:10.748785 8376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:10.748853 8376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.748915 8376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:10.748965 8376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.757616 8376 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:39777
I20260807 02:17:10.757638 8555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:39777 every 8 connection(s)
I20260807 02:17:10.758491 8376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:10.762746 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 8376
I20260807 02:17:10.762876 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:10.763216 1531 external_mini_cluster.cc:1428] Setting key 068f0d6b58cfeda153178d1ec706d9e9
I20260807 02:17:10.764726 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.760371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:37883 (local address 127.1.126.254:46073)
0807 02:17:10.760534 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.760537 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.761537 (+ 1000us) server_negotiation.cc:407] Connection header received
0807 02:17:10.762982 (+ 1445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.762984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.763022 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.763096 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.764283 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.764287 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.764289 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.764301 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.764322 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.764331 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.764417 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.764547 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.764586 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 02:17:10.765434 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46073
--builtin_ntp_servers=127.1.126.212:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 02:17:10.765818 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.760770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46073 (local address 127.1.126.194:37883)
0807 02:17:10.761386 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.761422 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.762747 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.763295 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.763306 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.763411 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:10.764022 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:10.764024 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:10.764070 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:10.764139 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:10.764414 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:10.764421 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:10.764425 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.764578 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.764826 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":108,"threads_started":1}
I20260807 02:17:10.766968 8556 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46073
I20260807 02:17:10.767221 8556 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:10.767721 8556 heartbeater.cc:511] Master 127.1.126.254:46073 requested a full tablet report, sending...
I20260807 02:17:10.768879 8099 ts_manager.cc:194] Registered new tserver with Master: 19ab40c1a6a54b33b72b17237c3daf1c (127.1.126.194:39777)
W20260807 02:17:10.878813 8560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:10.879060 8560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:10.879098 8560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:10.883080 8560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:10.883128 8560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:10.883181 8560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:10.887959 8560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:46073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:10.888947 8560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:10.890266 8560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:10.899825 8573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:10.899843 8569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.899945 8560 server_base.cc:1034] running on GCE node
W20260807 02:17:10.899874 8570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:10.900555 8560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:10.901196 8560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:10.902379 8560 hybrid_clock.cc:648] HybridClock initialized: now 1786069030902365 us; error 31 us; skew 500 ppm
I20260807 02:17:10.904129 8560 webserver.cc:460] Webserver started at http://127.1.126.195:37941/ using document root <none> and password file <none>
I20260807 02:17:10.904820 8560 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:10.904912 8560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:10.905145 8560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:10.907208 8560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "18f05f24dcea49c093054edbfabb1d5d"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "7c7cdd4d28636e609353e9b19fa43f26"
server_key_iv: "4508b9d8d8e91913f91e27e8759acf43"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.907753 8560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "18f05f24dcea49c093054edbfabb1d5d"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "7c7cdd4d28636e609353e9b19fa43f26"
server_key_iv: "4508b9d8d8e91913f91e27e8759acf43"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.911293 8560 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:10.913769 8586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.914969 8560 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:10.915107 8560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "18f05f24dcea49c093054edbfabb1d5d"
format_stamp: "Formatted at 2026-08-07 02:17:10 on dist-test-slave-39l8"
server_key: "7c7cdd4d28636e609353e9b19fa43f26"
server_key_iv: "4508b9d8d8e91913f91e27e8759acf43"
server_key_version: "encryptionkey@0"
I20260807 02:17:10.915215 8560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:10.919516 8560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:10.920068 8560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:10.920244 8560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:10.920784 8560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:10.921662 8560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:10.921732 8560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.921802 8560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:10.921862 8560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:10.930621 8560 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:45429
I20260807 02:17:10.930641 8755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:45429 every 8 connection(s)
I20260807 02:17:10.931507 8560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:10.933104 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 8560
I20260807 02:17:10.933230 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:10.933487 1531 external_mini_cluster.cc:1428] Setting key 5656f7670249444ab979c39bb58e150c
I20260807 02:17:10.937147 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.933241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:57183 (local address 127.1.126.254:46073)
0807 02:17:10.933378 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.933383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.934452 (+ 1069us) server_negotiation.cc:407] Connection header received
0807 02:17:10.935740 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.935742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.935777 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.935843 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.936795 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.936798 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.936799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.936809 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.936829 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.936836 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.936920 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.937021 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.937054 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:17:10.938031 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.933608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:46073 (local address 127.1.126.195:57183)
0807 02:17:10.934318 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.934366 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.935563 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.935992 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.935998 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.936075 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:10.936572 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:10.936573 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:10.936607 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:10.936668 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:10.936923 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:10.936929 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:10.936933 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.937048 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.937227 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":131,"threads_started":1}
I20260807 02:17:10.939075 8756 heartbeater.cc:347] Connected to a master server at 127.1.126.254:46073
I20260807 02:17:10.939289 8756 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:10.939610 8756 heartbeater.cc:511] Master 127.1.126.254:46073 requested a full tablet report, sending...
I20260807 02:17:10.940464 8099 ts_manager.cc:194] Registered new tserver with Master: 18f05f24dcea49c093054edbfabb1d5d (127.1.126.195:45429)
I20260807 02:17:10.947261 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:17:10.950470 8153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.949148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33300 (local address 127.1.126.254:46073)
0807 02:17:10.949262 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.949265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.949442 (+ 177us) server_negotiation.cc:407] Connection header received
0807 02:17:10.949505 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.949507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.949534 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.949595 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.950190 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.950193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.950194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.950204 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.950221 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.950228 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.950293 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.950358 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.950387 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:17:10.953087 8099 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:10.956038 8099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:10.967419 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.964333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39777 (local address 127.0.0.1:33442)
0807 02:17:10.964690 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.964738 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.964836 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.966029 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.966035 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.966107 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:10.966664 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:10.966673 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:10.966692 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:10.966778 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:10.967135 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:10.967145 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:10.967151 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.967240 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.967304 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":83,"threads_started":1}
I20260807 02:17:10.968112 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.964374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:45429 (local address 127.0.0.1:55900)
0807 02:17:10.965069 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.965081 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.965149 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.966269 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.966272 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.966288 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:10.967045 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:10.967048 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:10.967059 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:10.967086 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:10.967896 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:10.967899 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:10.967901 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.967968 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.968005 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":83,"threads_started":1}
I20260807 02:17:10.968210 8774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.964414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33442 (local address 127.1.126.194:39777)
0807 02:17:10.965409 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.965421 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.965451 (+ 30us) server_negotiation.cc:407] Connection header received
0807 02:17:10.965500 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.965504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.965697 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.965844 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.966940 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.966945 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.966958 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.966968 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.967009 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.967038 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.967940 (+ 902us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.967985 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.968051 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":130,"threads_started":1}
I20260807 02:17:10.968444 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.965683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.1.126.193:33461)
0807 02:17:10.966503 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.966515 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.966536 (+ 21us) server_negotiation.cc:407] Connection header received
0807 02:17:10.966630 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.966635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.966820 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.966951 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.967598 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.967606 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.967629 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.967644 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.967687 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.967723 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.967835 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.968193 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.968270 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":146,"threads_started":1}
I20260807 02:17:10.968652 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.965506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33461 (local address 127.0.0.1:42310)
0807 02:17:10.965729 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:10.965743 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:10.965820 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:10.966971 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:10.966977 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:10.966998 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:10.967417 (+ 419us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:10.967419 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:10.967429 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:10.967455 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:10.967808 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:10.967810 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:10.967813 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 02:17:10.967897 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 02:17:10.967931 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":103,"threads_started":1}
I20260807 02:17:10.968700 8776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:10.965092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55900 (local address 127.1.126.195:45429)
0807 02:17:10.965937 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:10.965953 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:10.965978 (+ 25us) server_negotiation.cc:407] Connection header received
0807 02:17:10.966017 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:10.966020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:10.966140 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:10.966277 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:10.967668 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:10.967674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:10.967684 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:10.967696 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:10.967735 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:10.967762 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:10.967857 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:10.968396 (+ 539us) server_negotiation.cc:299] Negotiation successful
0807 02:17:10.968480 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":749,"thread_start_us":167,"threads_started":1}
I20260807 02:17:10.971385 8278 tablet_service.cc:1467] Processing CreateTablet for tablet 16bc7cdab78241dba7af5c88932d859a (DEFAULT_TABLE table=test-table [id=81b8ff596f8f48a19dd4f5692cab3220]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:10.971385 8460 tablet_service.cc:1467] Processing CreateTablet for tablet 16bc7cdab78241dba7af5c88932d859a (DEFAULT_TABLE table=test-table [id=81b8ff596f8f48a19dd4f5692cab3220]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:10.971381 8656 tablet_service.cc:1467] Processing CreateTablet for tablet 16bc7cdab78241dba7af5c88932d859a (DEFAULT_TABLE table=test-table [id=81b8ff596f8f48a19dd4f5692cab3220]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:10.972386 8278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16bc7cdab78241dba7af5c88932d859a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:10.972427 8460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16bc7cdab78241dba7af5c88932d859a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:10.972427 8656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16bc7cdab78241dba7af5c88932d859a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:10.978416 8782 tablet_bootstrap.cc:492] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716: Bootstrap starting.
I20260807 02:17:10.979840 8783 tablet_bootstrap.cc:492] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Bootstrap starting.
I20260807 02:17:10.979840 8784 tablet_bootstrap.cc:492] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Bootstrap starting.
I20260807 02:17:10.981238 8782 tablet_bootstrap.cc:654] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:10.981933 8784 tablet_bootstrap.cc:654] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:10.981933 8783 tablet_bootstrap.cc:654] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:10.981962 8782 log.cc:824] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:10.982748 8784 log.cc:824] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:10.982749 8783 log.cc:824] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:10.983961 8782 tablet_bootstrap.cc:492] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716: No bootstrap required, opened a new log
I20260807 02:17:10.984162 8782 ts_tablet_manager.cc:1397] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 02:17:10.984463 8783 tablet_bootstrap.cc:492] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: No bootstrap required, opened a new log
I20260807 02:17:10.984648 8783 ts_tablet_manager.cc:1397] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 02:17:10.984912 8784 tablet_bootstrap.cc:492] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: No bootstrap required, opened a new log
I20260807 02:17:10.985139 8784 ts_tablet_manager.cc:1397] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:17:10.987965 8782 raft_consensus.cc:348] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:10.988209 8782 raft_consensus.cc:374] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:10.988289 8782 raft_consensus.cc:729] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab57c81dd7064db6a2b81f242e3d0716, State: Initialized, Role: FOLLOWER
I20260807 02:17:10.988715 8782 consensus_queue.cc:260] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:10.988919 8783 raft_consensus.cc:348] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:10.989228 8783 raft_consensus.cc:374] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:10.989307 8373 heartbeater.cc:503] Master 127.1.126.254:46073 was elected leader, sending a full tablet report...
I20260807 02:17:10.989321 8783 raft_consensus.cc:729] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f05f24dcea49c093054edbfabb1d5d, State: Initialized, Role: FOLLOWER
I20260807 02:17:10.989382 8784 raft_consensus.cc:348] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:10.989595 8784 raft_consensus.cc:374] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:10.989643 8784 raft_consensus.cc:729] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19ab40c1a6a54b33b72b17237c3daf1c, State: Initialized, Role: FOLLOWER
I20260807 02:17:10.989660 8782 ts_tablet_manager.cc:1428] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 02:17:10.989837 8783 consensus_queue.cc:260] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:10.990039 8784 consensus_queue.cc:260] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:10.990490 8756 heartbeater.cc:503] Master 127.1.126.254:46073 was elected leader, sending a full tablet report...
I20260807 02:17:10.990833 8783 ts_tablet_manager.cc:1428] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:17:10.991009 8784 ts_tablet_manager.cc:1428] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:17:10.991362 8556 heartbeater.cc:503] Master 127.1.126.254:46073 was elected leader, sending a full tablet report...
W20260807 02:17:11.009604 8558 tablet.cc:2369] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:17:11.017344 8790 raft_consensus.cc:482] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:11.017508 8790 raft_consensus.cc:504] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:11.018447 8790 leader_election.cc:288] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19ab40c1a6a54b33b72b17237c3daf1c (127.1.126.194:39777), ab57c81dd7064db6a2b81f242e3d0716 (127.1.126.193:33461)
I20260807 02:17:11.020524 8774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.018794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:47617 (local address 127.1.126.194:39777)
0807 02:17:11.018908 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.018912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.019143 (+ 231us) server_negotiation.cc:407] Connection header received
0807 02:17:11.019238 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.019241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.019274 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.019361 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:11.020153 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:11.020156 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:11.020157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:11.020167 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:11.020183 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:11.020190 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:11.020258 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:11.020359 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 02:17:11.020397 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:17:11.020562 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.018874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:49779 (local address 127.1.126.193:33461)
0807 02:17:11.018985 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.018989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.019003 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:11.019043 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.019045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.019087 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.019197 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:11.020001 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:11.020004 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:11.020007 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:11.020019 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:11.020038 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:11.020049 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:11.020139 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:11.020406 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 02:17:11.020445 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:17:11.020562 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.018661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33461 (local address 127.1.126.195:49779)
0807 02:17:11.018814 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:11.018834 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:11.018910 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:11.019238 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:11.019241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:11.019257 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:11.019810 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:11.019813 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:11.019827 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:11.019863 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:11.020295 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:11.020297 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:11.020299 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 02:17:11.020396 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 02:17:11.020433 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 02:17:11.020566 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.018661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39777 (local address 127.1.126.195:47617)
0807 02:17:11.019046 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:11.019059 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:11.019159 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:11.019383 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:11.019386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:11.019437 (+ 51us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:11.020001 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:11.020003 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:11.020013 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:11.020039 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:11.020259 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:11.020261 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:11.020263 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 02:17:11.020351 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 02:17:11.020389 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":77,"thread_start_us":123,"threads_started":1}
I20260807 02:17:11.021322 8485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16bc7cdab78241dba7af5c88932d859a" candidate_uuid: "18f05f24dcea49c093054edbfabb1d5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" is_pre_election: true
I20260807 02:17:11.021322 8301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16bc7cdab78241dba7af5c88932d859a" candidate_uuid: "18f05f24dcea49c093054edbfabb1d5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab57c81dd7064db6a2b81f242e3d0716" is_pre_election: true
I20260807 02:17:11.021587 8485 raft_consensus.cc:2454] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f05f24dcea49c093054edbfabb1d5d in term 0.
I20260807 02:17:11.021587 8301 raft_consensus.cc:2454] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f05f24dcea49c093054edbfabb1d5d in term 0.
I20260807 02:17:11.022059 8587 leader_election.cc:302] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 18f05f24dcea49c093054edbfabb1d5d, 19ab40c1a6a54b33b72b17237c3daf1c, ab57c81dd7064db6a2b81f242e3d0716; no voters:
I20260807 02:17:11.022315 8790 raft_consensus.cc:2781] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:11.022389 8790 raft_consensus.cc:482] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:11.022420 8790 raft_consensus.cc:3037] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:11.023598 8790 raft_consensus.cc:504] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:11.023942 8790 leader_election.cc:288] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [CANDIDATE]: Term 1 election: Requested vote from peers 19ab40c1a6a54b33b72b17237c3daf1c (127.1.126.194:39777), ab57c81dd7064db6a2b81f242e3d0716 (127.1.126.193:33461)
I20260807 02:17:11.024299 8485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16bc7cdab78241dba7af5c88932d859a" candidate_uuid: "18f05f24dcea49c093054edbfabb1d5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19ab40c1a6a54b33b72b17237c3daf1c"
I20260807 02:17:11.024299 8301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16bc7cdab78241dba7af5c88932d859a" candidate_uuid: "18f05f24dcea49c093054edbfabb1d5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab57c81dd7064db6a2b81f242e3d0716"
I20260807 02:17:11.024422 8485 raft_consensus.cc:3037] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:11.024422 8301 raft_consensus.cc:3037] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:11.025839 8485 raft_consensus.cc:2454] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f05f24dcea49c093054edbfabb1d5d in term 1.
I20260807 02:17:11.025839 8301 raft_consensus.cc:2454] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f05f24dcea49c093054edbfabb1d5d in term 1.
I20260807 02:17:11.026160 8588 leader_election.cc:302] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f05f24dcea49c093054edbfabb1d5d, ab57c81dd7064db6a2b81f242e3d0716; no voters:
I20260807 02:17:11.026403 8790 raft_consensus.cc:2781] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:11.026572 8790 raft_consensus.cc:686] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 1 LEADER]: Becoming Leader. State: Replica: 18f05f24dcea49c093054edbfabb1d5d, State: Running, Role: LEADER
I20260807 02:17:11.026917 8790 consensus_queue.cc:237] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } }
I20260807 02:17:11.029866 8098 catalog_manager.cc:5495] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f05f24dcea49c093054edbfabb1d5d (127.1.126.195). New cstate: current_term: 1 leader_uuid: "18f05f24dcea49c093054edbfabb1d5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f05f24dcea49c093054edbfabb1d5d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 } health_report { overall_health: UNKNOWN } } }
I20260807 02:17:11.044102 8776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.042735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55914 (local address 127.1.126.195:45429)
0807 02:17:11.042850 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.042853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.042864 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:17:11.042976 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.042978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.043044 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.043119 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:11.043770 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:11.043772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:11.043774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:11.043782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:11.043795 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:11.043801 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:11.043858 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:11.043926 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 02:17:11.043955 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 02:17:11.049842 8485 raft_consensus.cc:1261] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 1 FOLLOWER]: Refusing update from remote peer 18f05f24dcea49c093054edbfabb1d5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:11.049844 8301 raft_consensus.cc:1261] T 16bc7cdab78241dba7af5c88932d859a P ab57c81dd7064db6a2b81f242e3d0716 [term 1 FOLLOWER]: Refusing update from remote peer 18f05f24dcea49c093054edbfabb1d5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:11.050534 8793 consensus_queue.cc:1035] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "19ab40c1a6a54b33b72b17237c3daf1c" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:11.050731 8790 consensus_queue.cc:1035] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab57c81dd7064db6a2b81f242e3d0716" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:11.059203 8797 mvcc.cc:205] Tried to move back new op lower bound from 7315738751173849088 to 7315738751088996352. Current Snapshot: MvccSnapshot[applied={T|T < 7315738751173849088}]
I20260807 02:17:11.059511 8798 mvcc.cc:205] Tried to move back new op lower bound from 7315738751173849088 to 7315738751088996352. Current Snapshot: MvccSnapshot[applied={T|T < 7315738751173849088}]
I20260807 02:17:11.066095 8099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:11.066254 8099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:11.068576 8099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be69d120a5644c8c9214366f7bfa300a: Sending DeleteTablet for 3 replicas of tablet 16bc7cdab78241dba7af5c88932d859a
I20260807 02:17:11.069276 8460 tablet_service.cc:1514] Processing DeleteTablet for tablet 16bc7cdab78241dba7af5c88932d859a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:11 UTC) from {username='slave'} at 127.0.0.1:33442
I20260807 02:17:11.069305 8656 tablet_service.cc:1514] Processing DeleteTablet for tablet 16bc7cdab78241dba7af5c88932d859a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:11 UTC) from {username='slave'} at 127.0.0.1:55900
I20260807 02:17:11.069713 8809 tablet_replica.cc:330] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: stopping tablet replica
I20260807 02:17:11.069945 8278 tablet_service.cc:1514] Processing DeleteTablet for tablet 16bc7cdab78241dba7af5c88932d859a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:11 UTC) from {username='slave'} at 127.0.0.1:42310
I20260807 02:17:11.070001 8809 raft_consensus.cc:2229] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:11.070252 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 8186
I20260807 02:17:11.070304 8809 raft_consensus.cc:2258] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:11.070399 8810 tablet_replica.cc:330] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: stopping tablet replica
I20260807 02:17:11.070932 8810 raft_consensus.cc:2229] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:11.071310 8810 raft_consensus.cc:2258] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:11.074304 8810 ts_tablet_manager.cc:1905] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:11.077442 8810 ts_tablet_manager.cc:1918] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:11.077594 8810 log.cc:1196] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/16bc7cdab78241dba7af5c88932d859a
I20260807 02:17:11.077651 8809 ts_tablet_manager.cc:1905] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:11.078054 8810 ts_tablet_manager.cc:1939] T 16bc7cdab78241dba7af5c88932d859a P 18f05f24dcea49c093054edbfabb1d5d: Deleting consensus metadata
I20260807 02:17:11.079344 8080 catalog_manager.cc:4841] TS 18f05f24dcea49c093054edbfabb1d5d (127.1.126.195:45429): tablet 16bc7cdab78241dba7af5c88932d859a (table test-table [id=81b8ff596f8f48a19dd4f5692cab3220]) successfully deleted
I20260807 02:17:11.081179 8809 ts_tablet_manager.cc:1918] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:11.081301 8809 log.cc:1196] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/16bc7cdab78241dba7af5c88932d859a
I20260807 02:17:11.081707 8809 ts_tablet_manager.cc:1939] T 16bc7cdab78241dba7af5c88932d859a P 19ab40c1a6a54b33b72b17237c3daf1c: Deleting consensus metadata
I20260807 02:17:11.083001 8077 catalog_manager.cc:4841] TS 19ab40c1a6a54b33b72b17237c3daf1c (127.1.126.194:39777): tablet 16bc7cdab78241dba7af5c88932d859a (table test-table [id=81b8ff596f8f48a19dd4f5692cab3220]) successfully deleted
W20260807 02:17:11.084275 8078 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:33461 (error 108)
I20260807 02:17:11.084564 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 8376
I20260807 02:17:11.101308 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.100951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33461 (local address 127.0.0.1:42326)
0807 02:17:11.101120 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:11.101213 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 02:17:11.101528 8078 catalog_manager.cc:4584] TS ab57c81dd7064db6a2b81f242e3d0716 (127.1.126.193:33461): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 16bc7cdab78241dba7af5c88932d859a: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33461: connect: Connection refused (error 111)
I20260807 02:17:11.106279 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 8560
I20260807 02:17:11.116781 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 8058
2026-08-07T02:17:11Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (988 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 02:17:11.142769 1531 mini_oidc.cc:152] Starting JWKS server
I20260807 02:17:11.144325 1531 webserver.cc:460] Webserver started at https://127.0.0.1:34221/ using document root <none> and password file <none>
I20260807 02:17:11.144479 1531 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 02:17:11.144740 1531 webserver.cc:460] Webserver started at http://127.0.0.1:32931/ using document root <none> and password file <none>
2026-08-07T02:17:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:11Z Disabled control of system clock
I20260807 02:17:11.154261 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45581
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:35707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45581
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34221/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/testchainca.cert with env {}
W20260807 02:17:11.265487 8822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:11.265724 8822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:11.265763 8822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:11.269539 8822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:11.269585 8822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:11.269600 8822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:11.269615 8822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:11.269629 8822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 02:17:11.269644 8822 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 02:17:11.269657 8822 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34221/jwks.json
I20260807 02:17:11.274645 8822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:35707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45581
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34221/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:11.275516 8822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:11.276364 8822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:11.284549 8830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:11.284556 8831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:11.284576 8834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:11.284694 8822 server_base.cc:1034] running on GCE node
I20260807 02:17:11.285349 8822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:11.286363 8822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:11.287518 8822 hybrid_clock.cc:648] HybridClock initialized: now 1786069031287489 us; error 39 us; skew 500 ppm
I20260807 02:17:11.289237 8822 webserver.cc:460] Webserver started at http://127.1.126.254:43355/ using document root <none> and password file <none>
I20260807 02:17:11.289783 8822 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:11.289844 8822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:11.290072 8822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:11.292097 8822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "698cc24645f0451ba7ee38d1a42dcc40"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "6456beaf3bf1e30408c08ccd34133886"
server_key_iv: "da598cb406ec958c9e57bf73154d6cfc"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.292654 8822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "698cc24645f0451ba7ee38d1a42dcc40"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "6456beaf3bf1e30408c08ccd34133886"
server_key_iv: "da598cb406ec958c9e57bf73154d6cfc"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.296125 8822 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:11.298418 8842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:11.299600 8822 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:11.299741 8822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "698cc24645f0451ba7ee38d1a42dcc40"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "6456beaf3bf1e30408c08ccd34133886"
server_key_iv: "da598cb406ec958c9e57bf73154d6cfc"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.299844 8822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:11.318037 8822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:11.318681 8822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:11.318923 8822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:11.325949 8822 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45581
I20260807 02:17:11.325956 8919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45581 every 8 connection(s)
I20260807 02:17:11.326882 8822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:11.329953 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 8822
I20260807 02:17:11.330089 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:11.330250 8922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:11.330412 1531 external_mini_cluster.cc:1428] Setting key 4e7c948511dbc92e22eaa6e71e3912ac
I20260807 02:17:11.337145 8922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40: Bootstrap starting.
I20260807 02:17:11.339701 8927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.331742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34530 (local address 127.1.126.254:45581)
0807 02:17:11.332352 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.332367 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.332400 (+ 33us) server_negotiation.cc:407] Connection header received
0807 02:17:11.333007 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.333022 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.333407 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.333660 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:11.334007 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.334992 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.336215 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.336659 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.336769 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.337719 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:11.337725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:11.337740 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:11.338195 (+ 455us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:11.338277 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:11.338308 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:11.338411 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:11.338529 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 02:17:11.338808 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":136,"threads_started":1}
I20260807 02:17:11.339835 8922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:11.340572 8922 log.cc:824] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:11.342622 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:17:11.342648 8922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40: No bootstrap required, opened a new log
I20260807 02:17:11.346374 8922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698cc24645f0451ba7ee38d1a42dcc40" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45581 } }
I20260807 02:17:11.346588 8922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:11.346678 8922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 698cc24645f0451ba7ee38d1a42dcc40, State: Initialized, Role: FOLLOWER
I20260807 02:17:11.347127 8922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698cc24645f0451ba7ee38d1a42dcc40" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45581 } }
I20260807 02:17:11.347271 8922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:11.347359 8922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:11.347474 8922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:11.348357 8922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698cc24645f0451ba7ee38d1a42dcc40" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45581 } }
I20260807 02:17:11.348696 8922 leader_election.cc:302] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 698cc24645f0451ba7ee38d1a42dcc40; no voters:
I20260807 02:17:11.348987 8922 leader_election.cc:288] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:11.349172 8929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:11.349400 8929 raft_consensus.cc:686] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [term 1 LEADER]: Becoming Leader. State: Replica: 698cc24645f0451ba7ee38d1a42dcc40, State: Running, Role: LEADER
I20260807 02:17:11.349714 8929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698cc24645f0451ba7ee38d1a42dcc40" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45581 } }
I20260807 02:17:11.350179 8922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:11.351372 8930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "698cc24645f0451ba7ee38d1a42dcc40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698cc24645f0451ba7ee38d1a42dcc40" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45581 } } }
I20260807 02:17:11.351372 8934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 698cc24645f0451ba7ee38d1a42dcc40. Latest consensus state: current_term: 1 leader_uuid: "698cc24645f0451ba7ee38d1a42dcc40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698cc24645f0451ba7ee38d1a42dcc40" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45581 } } }
I20260807 02:17:11.351531 8934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:11.351531 8930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:11.352557 8943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:11.355561 8943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:11.360222 8943 catalog_manager.cc:1347] Generated new cluster ID: 5d28ad788f2e44549e8bf92ba0b1de76
I20260807 02:17:11.360281 8943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:11.370869 8943 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:11.371964 8943 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:11.383037 8943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 698cc24645f0451ba7ee38d1a42dcc40: Generated new TSK 0
I20260807 02:17:11.383747 8943 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 02:17:11.420722 8968 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 02:17:11.420836 8968 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 02:17:11.421418 8927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.403352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34544 (local address 127.1.126.254:45581)
0807 02:17:11.403491 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.403496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.403684 (+ 188us) server_negotiation.cc:407] Connection header received
0807 02:17:11.403876 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.403880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.403947 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.404054 (+ 107us) server_negotiation.cc:226] Negotiated authn=JWT
0807 02:17:11.404360 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.405194 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.406115 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.406469 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.406577 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.406959 (+ 382us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 02:17:11.421035 (+ 14076us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34221/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 02:17:11.421277 (+ 242us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34544: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34221/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 02:17:11.421485 8927 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34544: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34221/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 02:17:11.422861 8962 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:11.403246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45581 (local address 127.0.0.1:34544)
0807 02:17:11.403602 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:11.403615 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:11.403722 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:11.404081 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:11.404084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:11.404090 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0807 02:17:11.404216 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:11.404221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.405315 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.405317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:11.405996 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:11.406004 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.406587 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.406590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:11.406662 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.406762 (+ 100us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 02:17:11.421245 (+ 14483us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34221/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 02:17:11.421420 (+ 175us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.126.254:45581: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34221/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":104,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.1.126.254:45581: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34221/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 02:17:11.423651 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 8822
2026-08-07T02:17:11Z chronyd exiting
I20260807 02:17:11.469117 1531 test_util.cc:175] -----------------------------------------------
I20260807 02:17:11.469239 1531 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786069003535869-1531-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (328 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 02:17:11.470242 1531 mini_oidc.cc:152] Starting JWKS server
I20260807 02:17:11.471174 1531 webserver.cc:460] Webserver started at https://127.0.0.1:37769/ using document root <none> and password file <none>
I20260807 02:17:11.471300 1531 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 02:17:11.471557 1531 webserver.cc:460] Webserver started at http://127.0.0.1:35421/ using document root <none> and password file <none>
2026-08-07T02:17:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:11Z Disabled control of system clock
I20260807 02:17:11.481588 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:41101
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:42073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:41101
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37769/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/testchainca.cert with env {}
W20260807 02:17:11.592720 8974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:11.592969 8974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:11.593008 8974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:11.596900 8974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:11.596951 8974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:11.596966 8974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:11.596982 8974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:11.596997 8974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 02:17:11.597012 8974 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 02:17:11.597025 8974 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37769/jwks.json
I20260807 02:17:11.602641 8974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:42073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:41101
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37769/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:11.603673 8974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:11.604604 8974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:11.612774 8989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:11.612811 8984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:11.612825 8986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:11.612929 8974 server_base.cc:1034] running on GCE node
I20260807 02:17:11.613606 8974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:11.614657 8974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:11.615868 8974 hybrid_clock.cc:648] HybridClock initialized: now 1786069031615849 us; error 28 us; skew 500 ppm
I20260807 02:17:11.617563 8974 webserver.cc:460] Webserver started at http://127.1.126.254:45197/ using document root <none> and password file <none>
I20260807 02:17:11.618124 8974 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:11.618214 8974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:11.618466 8974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:11.620469 8974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "a35335432f2c27172dff395f8d5fc882"
server_key_iv: "2ba3d22e786cbb9988a0ff399686f8b5"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.621042 8974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "a35335432f2c27172dff395f8d5fc882"
server_key_iv: "2ba3d22e786cbb9988a0ff399686f8b5"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.624492 8974 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:11.626792 8998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:11.627882 8974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:11.628021 8974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "a35335432f2c27172dff395f8d5fc882"
server_key_iv: "2ba3d22e786cbb9988a0ff399686f8b5"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.628127 8974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:11.648581 8974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:11.649238 8974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:11.649447 8974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:11.656432 8974 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:41101
I20260807 02:17:11.656479 9087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:41101 every 8 connection(s)
I20260807 02:17:11.657533 8974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:11.660317 9088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:11.665740 9088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5: Bootstrap starting.
I20260807 02:17:11.667349 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 8974
I20260807 02:17:11.667479 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:11.667815 1531 external_mini_cluster.cc:1428] Setting key 89791f6905060d3d07d51375a775e2a8
I20260807 02:17:11.668413 9088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:11.669289 9088 log.cc:824] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:11.671674 9088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5: No bootstrap required, opened a new log
I20260807 02:17:11.675853 9088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41101 } }
I20260807 02:17:11.676158 9088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:11.676259 9088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ccb57ac21364f60b8ffbd7eb3691ce5, State: Initialized, Role: FOLLOWER
I20260807 02:17:11.676678 9088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41101 } }
I20260807 02:17:11.676828 9088 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:11.676914 9088 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:11.677029 9088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:11.677274 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.668895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56330 (local address 127.1.126.254:41101)
0807 02:17:11.669523 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.669539 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.669574 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:17:11.670419 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.670440 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.670848 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.671123 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:11.671504 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.672559 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.673771 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.674242 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.674358 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.675281 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:11.675285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:11.675298 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:11.675686 (+ 388us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:11.675737 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:11.675757 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:11.675836 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:11.676012 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 02:17:11.676335 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":130,"threads_started":1}
I20260807 02:17:11.677928 9088 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41101 } }
I20260807 02:17:11.678301 9088 leader_election.cc:302] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ccb57ac21364f60b8ffbd7eb3691ce5; no voters:
I20260807 02:17:11.678618 9088 leader_election.cc:288] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:11.678769 9095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:11.678999 9095 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [term 1 LEADER]: Becoming Leader. State: Replica: 0ccb57ac21364f60b8ffbd7eb3691ce5, State: Running, Role: LEADER
I20260807 02:17:11.679677 9095 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41101 } }
I20260807 02:17:11.679850 9088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:11.680114 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:17:11.681488 9097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ccb57ac21364f60b8ffbd7eb3691ce5. Latest consensus state: current_term: 1 leader_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41101 } } }
I20260807 02:17:11.681617 9097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:11.682014 9108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:11.682467 9096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccb57ac21364f60b8ffbd7eb3691ce5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41101 } } }
I20260807 02:17:11.682586 9096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:11.684846 9108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:11.689821 9108 catalog_manager.cc:1347] Generated new cluster ID: 058e82c3db1543aca94b1bfb16ddca1b
I20260807 02:17:11.689881 9108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:11.702787 9108 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:11.703871 9108 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:11.712620 9108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ccb57ac21364f60b8ffbd7eb3691ce5: Generated new TSK 0
I20260807 02:17:11.713241 9108 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 02:17:11.737807 9136 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 02:17:11.737883 9136 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 02:17:11.738440 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.722927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56346 (local address 127.1.126.254:41101)
0807 02:17:11.723048 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.723053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.723268 (+ 215us) server_negotiation.cc:407] Connection header received
0807 02:17:11.723389 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.723392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.723447 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.723554 (+ 107us) server_negotiation.cc:226] Negotiated authn=JWT
0807 02:17:11.723762 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.724569 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.725396 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.725757 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.725853 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.726125 (+ 272us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 02:17:11.738113 (+ 11988us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37769/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 02:17:11.738324 (+ 211us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56346: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37769/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 02:17:11.738494 9093 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56346: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37769/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 02:17:11.738476 9135 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:11.722869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41101 (local address 127.0.0.1:56346)
0807 02:17:11.723184 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:11.723196 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:11.723289 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:11.723560 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:11.723562 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:11.723568 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0807 02:17:11.723663 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:11.723667 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.724672 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.724674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:11.725285 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:11.725292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.725875 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.725878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:11.725947 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.725970 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 02:17:11.738250 (+ 12280us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37769/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 02:17:11.738357 (+ 107us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.126.254:41101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37769/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":112,"threads_started":1}
I20260807 02:17:11.739542 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 8974
2026-08-07T02:17:11Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (314 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 02:17:11.785079 1531 mini_oidc.cc:152] Starting JWKS server
I20260807 02:17:11.785889 1531 webserver.cc:460] Webserver started at https://127.0.0.1:45201/ using document root <none> and password file <none>
I20260807 02:17:11.785997 1531 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 02:17:11.786293 1531 webserver.cc:460] Webserver started at http://127.0.0.1:43519/ using document root <none> and password file <none>
2026-08-07T02:17:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:11Z Disabled control of system clock
I20260807 02:17:11.795811 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36571
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:37271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36571
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45201/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 02:17:11.902995 9146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:11.903209 9146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:11.903245 9146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:11.907060 9146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:11.907105 9146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:11.907120 9146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:11.907136 9146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:11.907150 9146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 02:17:11.907166 9146 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 02:17:11.907178 9146 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45201/jwks.json
I20260807 02:17:11.911587 9146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36571
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45201/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:11.912474 9146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:11.913695 9146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:11.921731 9166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:11.921770 9155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:11.921988 9146 server_base.cc:1034] running on GCE node
W20260807 02:17:11.921747 9161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:11.922652 9146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:11.923689 9146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:11.924872 9146 hybrid_clock.cc:648] HybridClock initialized: now 1786069031924847 us; error 37 us; skew 500 ppm
I20260807 02:17:11.926566 9146 webserver.cc:460] Webserver started at http://127.1.126.254:39737/ using document root <none> and password file <none>
I20260807 02:17:11.927184 9146 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:11.927279 9146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:11.927506 9146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:11.929389 9146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "389d2f5442a744f5921b4611d636c6cd"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "0527929f2a6c8ac9206949cc7b2ac8ce"
server_key_iv: "095ca06350554e30412acdc3a50cf136"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.929937 9146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "389d2f5442a744f5921b4611d636c6cd"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "0527929f2a6c8ac9206949cc7b2ac8ce"
server_key_iv: "095ca06350554e30412acdc3a50cf136"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.933465 9146 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:11.935772 9174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:11.936899 9146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:11.937045 9146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "389d2f5442a744f5921b4611d636c6cd"
format_stamp: "Formatted at 2026-08-07 02:17:11 on dist-test-slave-39l8"
server_key: "0527929f2a6c8ac9206949cc7b2ac8ce"
server_key_iv: "095ca06350554e30412acdc3a50cf136"
server_key_version: "encryptionkey@0"
I20260807 02:17:11.937160 9146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:11.953769 9146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:11.954351 9146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:11.954522 9146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:11.961177 9146 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36571
I20260807 02:17:11.961226 9248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36571 every 8 connection(s)
I20260807 02:17:11.962081 9146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:11.964955 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:11.969980 9252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd: Bootstrap starting.
I20260807 02:17:11.971508 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 9146
I20260807 02:17:11.971639 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:11.971939 1531 external_mini_cluster.cc:1428] Setting key 2f0db8b50046a0e30a4363e65100e2e4
I20260807 02:17:11.972635 9252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:11.973510 9252 log.cc:824] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:11.975445 9252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd: No bootstrap required, opened a new log
I20260807 02:17:11.978786 9252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389d2f5442a744f5921b4611d636c6cd" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36571 } }
I20260807 02:17:11.979051 9252 raft_consensus.cc:374] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:11.979110 9252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389d2f5442a744f5921b4611d636c6cd, State: Initialized, Role: FOLLOWER
I20260807 02:17:11.979557 9252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389d2f5442a744f5921b4611d636c6cd" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36571 } }
I20260807 02:17:11.979760 9252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:11.979863 9252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:11.979970 9252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:11.980612 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:11.972970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37606 (local address 127.1.126.254:36571)
0807 02:17:11.973523 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:11.973535 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:11.973565 (+ 30us) server_negotiation.cc:407] Connection header received
0807 02:17:11.974456 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:11.974474 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:11.974860 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:11.975184 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:11.975616 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.976518 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.977363 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:11.977807 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:11.977978 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:11.978787 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:11.978792 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:11.978803 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:11.979207 (+ 404us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:11.979290 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:11.979310 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:11.979428 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:11.979587 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 02:17:11.979877 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260807 02:17:11.980872 9252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389d2f5442a744f5921b4611d636c6cd" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36571 } }
I20260807 02:17:11.981202 9252 leader_election.cc:302] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 389d2f5442a744f5921b4611d636c6cd; no voters:
I20260807 02:17:11.981525 9252 leader_election.cc:288] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:11.981590 9257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:11.981838 9257 raft_consensus.cc:686] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [term 1 LEADER]: Becoming Leader. State: Replica: 389d2f5442a744f5921b4611d636c6cd, State: Running, Role: LEADER
I20260807 02:17:11.982194 9257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389d2f5442a744f5921b4611d636c6cd" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36571 } }
I20260807 02:17:11.982862 9252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:11.983438 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:17:11.984000 9259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 389d2f5442a744f5921b4611d636c6cd. Latest consensus state: current_term: 1 leader_uuid: "389d2f5442a744f5921b4611d636c6cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389d2f5442a744f5921b4611d636c6cd" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36571 } } }
I20260807 02:17:11.984010 9260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "389d2f5442a744f5921b4611d636c6cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389d2f5442a744f5921b4611d636c6cd" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36571 } } }
I20260807 02:17:11.984131 9259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:11.984135 9260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:11.984561 9270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:11.987792 9270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:11.992771 9270 catalog_manager.cc:1347] Generated new cluster ID: 1cb40a34655a4f298c371fa734abaf17
I20260807 02:17:11.992834 9270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:12.005766 9270 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:12.006608 9270 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:12.019141 9270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 389d2f5442a744f5921b4611d636c6cd: Generated new TSK 0
I20260807 02:17:12.019930 9270 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:12.039161 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:12.034477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37608 (local address 127.1.126.254:36571)
0807 02:17:12.034599 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:12.034611 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:12.034764 (+ 153us) server_negotiation.cc:407] Connection header received
0807 02:17:12.034933 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:12.034936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:12.034981 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:12.035067 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0807 02:17:12.035332 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.035850 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.037084 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.037293 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.037366 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:12.037680 (+ 314us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 02:17:12.038811 (+ 1131us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45201/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 02:17:12.039035 (+ 224us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37608: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45201/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 02:17:12.039233 9255 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37608: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45201/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 02:17:12.039275 9295 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:12.034323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36571 (local address 127.0.0.1:37608)
0807 02:17:12.034670 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:12.034686 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:12.034814 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:12.035092 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:12.035096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:12.035104 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 02:17:12.035223 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:12.035229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.035956 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.035960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:12.036960 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:12.036971 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.037408 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.037412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:12.037499 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:12.037527 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 02:17:12.038971 (+ 1444us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45201/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 02:17:12.039105 (+ 134us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.126.254:36571: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45201/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":109,"threads_started":1}
I20260807 02:17:12.040143 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 9146
E20260807 02:17:12.055848 9296 webserver.cc:533] Webserver: sslize failed:
E20260807 02:17:12.055912 9296 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T02:17:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (301 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T02:17:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:12Z Disabled control of system clock
I20260807 02:17:12.095968 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45395
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:34281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45395
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/testchainca.cert with env {}
W20260807 02:17:12.204536 9304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:12.204798 9304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:12.204912 9304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:12.209088 9304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:12.209172 9304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:12.209200 9304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:12.209259 9304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:12.209295 9304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 02:17:12.209331 9304 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 02:17:12.209358 9304 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 02:17:12.214582 9304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45395
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:12.215547 9304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:12.216583 9304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:12.225054 9316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:12.225086 9309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:12.225117 9304 server_base.cc:1034] running on GCE node
W20260807 02:17:12.225033 9313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:12.225908 9304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:12.226926 9304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:12.228106 9304 hybrid_clock.cc:648] HybridClock initialized: now 1786069032228091 us; error 46 us; skew 500 ppm
I20260807 02:17:12.229842 9304 webserver.cc:460] Webserver started at http://127.1.126.254:39229/ using document root <none> and password file <none>
I20260807 02:17:12.230387 9304 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:12.230446 9304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:12.230691 9304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:12.232721 9304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "99e06b06c0ad4e0198495211c8e5aa88"
format_stamp: "Formatted at 2026-08-07 02:17:12 on dist-test-slave-39l8"
server_key: "7fc5808f2cea4f782ac5637bc5dba817"
server_key_iv: "4764718f4fc452b0dd96ec35660004dc"
server_key_version: "encryptionkey@0"
I20260807 02:17:12.233253 9304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "99e06b06c0ad4e0198495211c8e5aa88"
format_stamp: "Formatted at 2026-08-07 02:17:12 on dist-test-slave-39l8"
server_key: "7fc5808f2cea4f782ac5637bc5dba817"
server_key_iv: "4764718f4fc452b0dd96ec35660004dc"
server_key_version: "encryptionkey@0"
I20260807 02:17:12.236681 9304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 02:17:12.238858 9322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:12.239962 9304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:17:12.240118 9304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "99e06b06c0ad4e0198495211c8e5aa88"
format_stamp: "Formatted at 2026-08-07 02:17:12 on dist-test-slave-39l8"
server_key: "7fc5808f2cea4f782ac5637bc5dba817"
server_key_iv: "4764718f4fc452b0dd96ec35660004dc"
server_key_version: "encryptionkey@0"
I20260807 02:17:12.240231 9304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:12.251101 9304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:12.251732 9304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:12.251915 9304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:12.259050 9304 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45395
I20260807 02:17:12.259083 9391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45395 every 8 connection(s)
I20260807 02:17:12.259909 9304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:12.261425 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 9304
I20260807 02:17:12.261570 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:12.261861 1531 external_mini_cluster.cc:1428] Setting key 55efaaa506c0655200ef4951eff1823d
I20260807 02:17:12.263147 9392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:12.269124 9392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88: Bootstrap starting.
I20260807 02:17:12.270434 9395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:12.263090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39758 (local address 127.1.126.254:45395)
0807 02:17:12.263701 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:12.263716 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:12.263750 (+ 34us) server_negotiation.cc:407] Connection header received
0807 02:17:12.264353 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:12.264368 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:12.264717 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:12.264975 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:12.265310 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.266229 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.267429 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.267866 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.267980 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:12.268858 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:12.268862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:12.268874 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:12.269218 (+ 344us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:12.269310 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:12.269332 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:12.269407 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:12.269565 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 02:17:12.269838 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":165,"threads_started":1}
I20260807 02:17:12.271454 9392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:12.272307 9392 log.cc:824] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:12.273247 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:17:12.274339 9392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88: No bootstrap required, opened a new log
I20260807 02:17:12.277498 9392 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e06b06c0ad4e0198495211c8e5aa88" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45395 } }
I20260807 02:17:12.277686 9392 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:12.277765 9392 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e06b06c0ad4e0198495211c8e5aa88, State: Initialized, Role: FOLLOWER
I20260807 02:17:12.278151 9392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e06b06c0ad4e0198495211c8e5aa88" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45395 } }
I20260807 02:17:12.278292 9392 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:12.278378 9392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:12.278482 9392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:12.279383 9392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e06b06c0ad4e0198495211c8e5aa88" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45395 } }
I20260807 02:17:12.279699 9392 leader_election.cc:302] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99e06b06c0ad4e0198495211c8e5aa88; no voters:
I20260807 02:17:12.279992 9392 leader_election.cc:288] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:12.280063 9398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:12.280329 9398 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [term 1 LEADER]: Becoming Leader. State: Replica: 99e06b06c0ad4e0198495211c8e5aa88, State: Running, Role: LEADER
I20260807 02:17:12.280684 9398 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e06b06c0ad4e0198495211c8e5aa88" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45395 } }
I20260807 02:17:12.281181 9392 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:12.282261 9399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99e06b06c0ad4e0198495211c8e5aa88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e06b06c0ad4e0198495211c8e5aa88" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45395 } } }
I20260807 02:17:12.282399 9399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:12.282711 9400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99e06b06c0ad4e0198495211c8e5aa88. Latest consensus state: current_term: 1 leader_uuid: "99e06b06c0ad4e0198495211c8e5aa88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e06b06c0ad4e0198495211c8e5aa88" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45395 } } }
I20260807 02:17:12.282868 9408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:12.282900 9400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:12.286130 9408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:12.291505 9408 catalog_manager.cc:1347] Generated new cluster ID: 654196968d964627aa730164dd27d5ca
I20260807 02:17:12.291599 9408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:12.303378 9408 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:12.304426 9408 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:12.309099 9408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99e06b06c0ad4e0198495211c8e5aa88: Generated new TSK 0
I20260807 02:17:12.309727 9408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:12.775529 9395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:12.322321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39774 (local address 127.1.126.254:45395)
0807 02:17:12.322456 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:12.322461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:12.322613 (+ 152us) server_negotiation.cc:407] Connection header received
0807 02:17:12.322767 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:12.322770 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:12.322832 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:12.322946 (+ 114us) server_negotiation.cc:226] Negotiated authn=JWT
0807 02:17:12.323176 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.324016 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.324881 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.325218 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.325331 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:12.325601 (+ 270us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 02:17:12.775122 (+449521us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 02:17:12.775395 (+ 273us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39774: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 02:17:12.775601 9395 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39774: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 02:17:12.775779 9430 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:12.322199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45395 (local address 127.0.0.1:39774)
0807 02:17:12.322528 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:12.322541 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:12.322638 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:12.322953 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:12.322955 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:12.322962 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0807 02:17:12.323066 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:12.323071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.324134 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.324136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:12.324769 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:12.324777 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:12.325349 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:12.325352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:12.325413 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:12.325434 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 02:17:12.775353 (+449919us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 02:17:12.775544 (+ 191us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.126.254:45395: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":108,"threads_started":1}
I20260807 02:17:12.776402 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 9304
2026-08-07T02:17:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (716 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (124 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (121 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:13 dist-test-slave-39l8 krb5kdc[9449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:13 dist-test-slave-39l8 krb5kdc[9449](info): set up 2 sockets
Aug 07 02:17:13 dist-test-slave-39l8 krb5kdc[9449](info): commencing operation
krb5kdc: starting...
W20260807 02:17:14.225276 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:14 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:14.345504 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:39559
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:14.454675 9464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:14.454973 9464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:14.455049 9464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:14.458930 9464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:14.459015 9464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:14.459054 9464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:14.459110 9464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:14.459149 9464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:14.464239 9464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:14.465229 9464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:14.466393 9464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:14.474666 9475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:14.474632 9471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:14.474690 9472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:14.474910 9464 server_base.cc:1034] running on GCE node
I20260807 02:17:14.475531 9464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:14.476562 9464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:14.477756 9464 hybrid_clock.cc:648] HybridClock initialized: now 1786069034477730 us; error 38 us; skew 500 ppm
Aug 07 02:17:14 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:14.480388 9464 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:14.481295 9464 webserver.cc:460] Webserver started at http://127.1.126.254:46129/ using document root <none> and password file <none>
I20260807 02:17:14.481854 9464 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:14.481950 9464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:14.482185 9464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:14.484228 9464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "7a1b2f9662424065a706b07d2d02328a"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "360aed95c160dab37cd734b81fdf2afc"
server_key_iv: "582153de0cf07f10be21a8f880abfaac"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.484795 9464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "7a1b2f9662424065a706b07d2d02328a"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "360aed95c160dab37cd734b81fdf2afc"
server_key_iv: "582153de0cf07f10be21a8f880abfaac"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.488355 9464 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:14.490643 9482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:14.491827 9464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:14.491971 9464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "7a1b2f9662424065a706b07d2d02328a"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "360aed95c160dab37cd734b81fdf2afc"
server_key_iv: "582153de0cf07f10be21a8f880abfaac"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.492091 9464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:14.513399 9464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:14.516105 9464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:14.516302 9464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:14.523294 9464 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:39559
I20260807 02:17:14.523308 9560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:39559 every 8 connection(s)
I20260807 02:17:14.524186 9464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:14.526867 9561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:14.531996 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 9464
I20260807 02:17:14.532155 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:14.532424 9561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a: Bootstrap starting.
I20260807 02:17:14.532449 1531 external_mini_cluster.cc:1428] Setting key 1c20c7bfeb4af09956fd1e9235f500d6
I20260807 02:17:14.534997 9561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:14.535887 9561 log.cc:824] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:14.537921 9561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a: No bootstrap required, opened a new log
Aug 07 02:17:14 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:14.542402 9561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1b2f9662424065a706b07d2d02328a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 39559 } }
I20260807 02:17:14.542680 9561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:14.542768 9561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1b2f9662424065a706b07d2d02328a, State: Initialized, Role: FOLLOWER
I20260807 02:17:14.543228 9561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1b2f9662424065a706b07d2d02328a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 39559 } }
I20260807 02:17:14.543390 9561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:14.543481 9561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:14.543598 9561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:14.544415 9561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1b2f9662424065a706b07d2d02328a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 39559 } }
I20260807 02:17:14.544797 9561 leader_election.cc:302] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a1b2f9662424065a706b07d2d02328a; no voters:
I20260807 02:17:14.545140 9561 leader_election.cc:288] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:14.545205 9568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:14.545405 9568 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [term 1 LEADER]: Becoming Leader. State: Replica: 7a1b2f9662424065a706b07d2d02328a, State: Running, Role: LEADER
I20260807 02:17:14.545743 9568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1b2f9662424065a706b07d2d02328a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 39559 } }
I20260807 02:17:14.546408 9561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:14.546999 9571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a1b2f9662424065a706b07d2d02328a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1b2f9662424065a706b07d2d02328a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 39559 } } }
I20260807 02:17:14.547116 9571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:14.547287 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:14.533722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.1.126.254:39559)
0807 02:17:14.534122 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:14.534140 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:14.534174 (+ 34us) server_negotiation.cc:407] Connection header received
0807 02:17:14.534808 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:14.534824 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:14.535203 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:14.535466 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:14.536386 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:14.537418 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:14.538518 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:14.539025 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:14.539189 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:14.541941 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:14.541946 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:14.541958 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:14.541984 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:14.543922 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:14.544375 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:14.544381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:14.544387 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:14.544521 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:14.544812 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:14.544815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:14.544817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:14.545335 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:14.545554 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:14.545843 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 02:17:14.546306 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":122,"threads_started":1}
I20260807 02:17:14.547834 9569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a1b2f9662424065a706b07d2d02328a. Latest consensus state: current_term: 1 leader_uuid: "7a1b2f9662424065a706b07d2d02328a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1b2f9662424065a706b07d2d02328a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 39559 } } }
I20260807 02:17:14.547921 9569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:14.549410 9576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:14.552120 9576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:14.558128 9576 catalog_manager.cc:1347] Generated new cluster ID: 568a93d6de8b409f82a20edfac15d97e
I20260807 02:17:14.558193 9576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:14.569191 9576 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:14.569995 9576 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:14.578192 9576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a1b2f9662424065a706b07d2d02328a: Generated new TSK 0
I20260807 02:17:14.578838 9576 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:14.613739 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:39559
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:14.722282 9601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:14.722549 9601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:14.722621 9601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:14.726603 9601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:14.726703 9601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:14.726805 9601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:14.731833 9601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:14.732887 9601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:14.733858 9601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:14.743178 9608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:14.743192 9607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:14.743185 9613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:14.743340 9601 server_base.cc:1034] running on GCE node
I20260807 02:17:14.743830 9601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:14.744395 9601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:14.745581 9601 hybrid_clock.cc:648] HybridClock initialized: now 1786069034745566 us; error 27 us; skew 500 ppm
Aug 07 02:17:14 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:14.751581 9601 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:14.752418 9601 webserver.cc:460] Webserver started at http://127.1.126.193:38483/ using document root <none> and password file <none>
I20260807 02:17:14.752902 9601 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:14.752959 9601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:14.753113 9601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:14.755054 9601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "d690c3e4d2de47ad99e4bfeda87ffe03"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "8c75954003c4e8a09c0834324de78889"
server_key_iv: "392dd06c510d66bcd8f06d2a5b11e418"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.755556 9601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "d690c3e4d2de47ad99e4bfeda87ffe03"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "8c75954003c4e8a09c0834324de78889"
server_key_iv: "392dd06c510d66bcd8f06d2a5b11e418"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.759033 9601 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:14.761253 9624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:14.762372 9601 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:14.762490 9601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "d690c3e4d2de47ad99e4bfeda87ffe03"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "8c75954003c4e8a09c0834324de78889"
server_key_iv: "392dd06c510d66bcd8f06d2a5b11e418"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.762588 9601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:14.790961 9601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:14.793598 9601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:14.793788 9601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:14.794353 9601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:14.795145 9601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:14.795198 9601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:14.795265 9601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:14.795296 9601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:14.804026 9601 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:45653
I20260807 02:17:14.804062 9780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:45653 every 8 connection(s)
I20260807 02:17:14.804870 9601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:14.810084 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 9601
I20260807 02:17:14.810216 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:14.810580 1531 external_mini_cluster.cc:1428] Setting key a65fbf6a29eec28ab6221e1867cda2a3
Aug 07 02:17:14 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:14.819797 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:14.806509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:36533 (local address 127.1.126.254:39559)
0807 02:17:14.806663 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:14.806668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:14.807534 (+ 866us) server_negotiation.cc:407] Connection header received
0807 02:17:14.809007 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:14.809010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:14.809069 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:14.809176 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:14.810555 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:14.811332 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:14.812848 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:14.813151 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:14.813262 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:14.816069 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:14.816076 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:14.816082 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:14.816113 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:14.817765 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:14.818238 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:14.818242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:14.818244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:14.818327 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:14.818673 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:14.818676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:14.818678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:14.818936 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:14.819047 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:14.819499 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 02:17:14.819626 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:17:14.820549 9786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:14.806932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:39559 (local address 127.1.126.193:36533)
0807 02:17:14.807381 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:14.807423 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:14.808799 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:14.809346 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:14.809353 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:14.809723 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:14.810380 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:14.810403 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:14.811457 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:14.811460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:14.812720 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:14.812735 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:14.813311 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:14.813317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:14.813542 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:14.814128 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:14.814156 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:14.815907 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:14.817879 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:14.817884 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:14.817894 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:14.818125 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:14.818430 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:14.818433 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:14.818435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:14.818566 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:14.819045 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:14.819052 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:14.819276 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 02:17:14.819456 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 02:17:14.819744 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:17:14.821746 9784 heartbeater.cc:347] Connected to a master server at 127.1.126.254:39559
I20260807 02:17:14.821985 9784 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:14.822441 9784 heartbeater.cc:511] Master 127.1.126.254:39559 requested a full tablet report, sending...
I20260807 02:17:14.823980 9505 ts_manager.cc:194] Registered new tserver with Master: d690c3e4d2de47ad99e4bfeda87ffe03 (127.1.126.193:45653)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:17:14.825578 9505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:36533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:14.838742 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:39559
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:14.945021 9791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:14.945225 9791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:14.945261 9791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:14.949525 9791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:14.949576 9791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:14.949671 9791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:14.954804 9791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:14.955746 9791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:14.956744 9791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:14.966102 9797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:14.966089 9800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:14.966253 9791 server_base.cc:1034] running on GCE node
W20260807 02:17:14.966089 9798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:14.966852 9791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:14.967495 9791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:14.968655 9791 hybrid_clock.cc:648] HybridClock initialized: now 1786069034968637 us; error 29 us; skew 500 ppm
Aug 07 02:17:14 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:14.971328 9791 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:14.972137 9791 webserver.cc:460] Webserver started at http://127.1.126.194:37473/ using document root <none> and password file <none>
I20260807 02:17:14.972692 9791 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:14.972779 9791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:14.973007 9791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:14.974972 9791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "0fd634154ce0472999c0820e2723640e"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "1c8e352e42cf2f006956b23691583228"
server_key_iv: "4b25b2df89dcf60333ebeedd3e864bf0"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.975512 9791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "0fd634154ce0472999c0820e2723640e"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "1c8e352e42cf2f006956b23691583228"
server_key_iv: "4b25b2df89dcf60333ebeedd3e864bf0"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.978935 9791 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:17:14.981389 9812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:14.982618 9791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:14.982798 9791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "0fd634154ce0472999c0820e2723640e"
format_stamp: "Formatted at 2026-08-07 02:17:14 on dist-test-slave-39l8"
server_key: "1c8e352e42cf2f006956b23691583228"
server_key_iv: "4b25b2df89dcf60333ebeedd3e864bf0"
server_key_version: "encryptionkey@0"
I20260807 02:17:14.982919 9791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:14.997640 9791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:15.000273 9791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:15.000465 9791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:15.001004 9791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:15.001821 9791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:15.001894 9791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:15.001965 9791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:15.002009 9791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:15.010325 9791 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42461
I20260807 02:17:15.010349 9973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42461 every 8 connection(s)
I20260807 02:17:15.011200 9791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:15.014302 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 9791
I20260807 02:17:15.014446 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:15.014786 1531 external_mini_cluster.cc:1428] Setting key 36a41f0468e5052a437c981cbb721802
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069034, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:17:15.025908 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.012976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:34445 (local address 127.1.126.254:39559)
0807 02:17:15.013122 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.013126 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.013999 (+ 873us) server_negotiation.cc:407] Connection header received
0807 02:17:15.015595 (+ 1596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.015598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.015639 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.015708 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.017050 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.017850 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.019452 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.019657 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.019746 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.022526 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:15.022529 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:15.022532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:15.022555 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:15.023953 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.024443 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.024446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.024448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.024530 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.024869 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.024873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.024875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.025047 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:15.025152 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:15.025630 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 02:17:15.025752 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:17:15.026650 9976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.013364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:39559 (local address 127.1.126.194:34445)
0807 02:17:15.013847 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:15.013887 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:15.015400 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:15.015868 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:15.015876 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:15.016390 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:15.016878 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:15.016891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.017981 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.017983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:15.019321 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:15.019334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.019824 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.019829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:15.020032 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.020607 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:15.020638 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:15.022359 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:15.024074 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:15.024080 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:15.024092 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:15.024325 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:15.024624 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:15.024628 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:15.024630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:15.024770 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:15.025162 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:15.025169 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:15.025399 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 02:17:15.025580 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 02:17:15.025862 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":125,"threads_started":1}
I20260807 02:17:15.027699 9974 heartbeater.cc:347] Connected to a master server at 127.1.126.254:39559
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
I20260807 02:17:15.027930 9974 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:15.028517 9974 heartbeater.cc:511] Master 127.1.126.254:39559 requested a full tablet report, sending...
I20260807 02:17:15.029757 9505 ts_manager.cc:194] Registered new tserver with Master: 0fd634154ce0472999c0820e2723640e (127.1.126.194:42461)
I20260807 02:17:15.030562 9505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:34445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:15.041240 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:39559
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:15.151022 9979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:15.151252 9979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:15.151331 9979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:15.155364 9979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:15.155416 9979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:15.155519 9979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:15.160666 9979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:15.161988 9979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:15.163182 9979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:15.172945 9979 server_base.cc:1034] running on GCE node
W20260807 02:17:15.172847 9985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:15.172873 9989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:15.172860 9986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:15.173516 9979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:15.174093 9979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:15.175241 9979 hybrid_clock.cc:648] HybridClock initialized: now 1786069035175211 us; error 42 us; skew 500 ppm
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.177707 9979 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:15.178427 9979 webserver.cc:460] Webserver started at http://127.1.126.195:38475/ using document root <none> and password file <none>
I20260807 02:17:15.179028 9979 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:15.179114 9979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:15.179330 9979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:15.181150 9979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "9b50a7d41b044de2b796739c2c33f860"
format_stamp: "Formatted at 2026-08-07 02:17:15 on dist-test-slave-39l8"
server_key: "b774462cb57fbc61fed6fa28601f890f"
server_key_iv: "220254840a84a0310c32380fb5343799"
server_key_version: "encryptionkey@0"
I20260807 02:17:15.181712 9979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "9b50a7d41b044de2b796739c2c33f860"
format_stamp: "Formatted at 2026-08-07 02:17:15 on dist-test-slave-39l8"
server_key: "b774462cb57fbc61fed6fa28601f890f"
server_key_iv: "220254840a84a0310c32380fb5343799"
server_key_version: "encryptionkey@0"
I20260807 02:17:15.185187 9979 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 02:17:15.187670 9999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:15.188791 9979 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:15.188920 9979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "9b50a7d41b044de2b796739c2c33f860"
format_stamp: "Formatted at 2026-08-07 02:17:15 on dist-test-slave-39l8"
server_key: "b774462cb57fbc61fed6fa28601f890f"
server_key_iv: "220254840a84a0310c32380fb5343799"
server_key_version: "encryptionkey@0"
I20260807 02:17:15.189020 9979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:15.215392 9979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:15.218132 9979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:15.218326 9979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:15.218968 9979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:15.219781 9979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:15.219851 9979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:15.219924 9979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:15.219971 9979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:15.228693 9979 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:45717
I20260807 02:17:15.228721 10159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:45717 every 8 connection(s)
I20260807 02:17:15.229537 9979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:15.237658 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 9979
I20260807 02:17:15.237785 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:15.238133 1531 external_mini_cluster.cc:1428] Setting key 9d5e6c069f55964bd4fcd0024a35a325
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:15.242944 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.231387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:49889 (local address 127.1.126.254:39559)
0807 02:17:15.231533 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.231537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.232276 (+ 739us) server_negotiation.cc:407] Connection header received
0807 02:17:15.233594 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.233596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.233645 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.233728 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.234919 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.235437 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.236486 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.236696 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.236769 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.239479 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:15.239481 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:15.239484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:15.239527 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:15.241153 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.241611 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.241614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.241615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.241690 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.241974 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.241976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.241977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.242145 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:15.242227 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:15.242670 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 02:17:15.242827 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:17:15.243731 10162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.231675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:39559 (local address 127.1.126.195:49889)
0807 02:17:15.232117 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:15.232159 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:15.233395 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:15.233893 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:15.233900 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:15.234242 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:15.234792 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:15.234808 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.235538 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.235540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:15.236387 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:15.236396 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.236818 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.236821 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:15.236971 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.237500 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:15.237523 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:15.239307 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:15.241262 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:15.241267 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:15.241279 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:15.241526 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:15.241770 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:15.241772 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:15.241773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:15.241898 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:15.242241 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:15.242246 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:15.242476 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 02:17:15.242626 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 02:17:15.242935 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":110,"threads_started":1}
I20260807 02:17:15.244856 10160 heartbeater.cc:347] Connected to a master server at 127.1.126.254:39559
I20260807 02:17:15.245118 10160 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:15.245597 10160 heartbeater.cc:511] Master 127.1.126.254:39559 requested a full tablet report, sending...
I20260807 02:17:15.246769 9505 ts_manager.cc:194] Registered new tserver with Master: 9b50a7d41b044de2b796739c2c33f860 (127.1.126.195:45717)
I20260807 02:17:15.247390 9505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:49889
I20260807 02:17:15.252125 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/test-admin.keytab.
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.267982 1531 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 02:17:15.270591 10169 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:15.269290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34794 (local address 127.1.126.193:45653)
0807 02:17:15.269579 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.269604 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.269626 (+ 22us) server_negotiation.cc:407] Connection header received
0807 02:17:15.269673 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.269677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.269836 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.269940 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.270388 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34794: BlockingRecv error: recv got EOF from 127.0.0.1:34794 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":99,"threads_started":1}
W20260807 02:17:15.270668 1531 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc' of type FILE
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.271673 1531 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.272915 1531 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:17:15.281924 10169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.273802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34798 (local address 127.1.126.193:45653)
0807 02:17:15.273915 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.273921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.273969 (+ 48us) server_negotiation.cc:407] Connection header received
0807 02:17:15.274109 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.274113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.274153 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.274242 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.274752 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.275442 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.276220 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.276562 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.276671 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.278700 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:15.278726 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:15.278740 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:15.278764 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:15.280116 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.280567 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.280578 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.280579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.280651 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.280952 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.280955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.280957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.281216 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:15.281415 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:15.281633 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 02:17:15.281787 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 02:17:15.285462 10169 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:15.284640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34812 (local address 127.1.126.193:45653)
0807 02:17:15.284770 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.284773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.284818 (+ 45us) server_negotiation.cc:407] Connection header received
0807 02:17:15.284907 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.284910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.284942 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.285005 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.285353 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34812: BlockingRecv error: recv got EOF from 127.0.0.1:34812 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 02:17:15.285734 1531 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc)
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.286597 1531 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.287509 1531 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:17:15.296000 10169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.288315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34820 (local address 127.1.126.193:45653)
0807 02:17:15.288437 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.288441 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.288533 (+ 92us) server_negotiation.cc:407] Connection header received
0807 02:17:15.288679 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.288682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.288719 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.288810 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.289284 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.289761 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.290490 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.290762 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.290876 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.293020 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:15.293023 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:15.293026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:15.293050 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:15.294345 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.294855 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.294859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.294863 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.294937 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.295218 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.295222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.295224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.295388 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:15.295515 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:15.295767 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 02:17:15.295875 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 02:17:15.298629 10169 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:15.297636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34832 (local address 127.1.126.193:45653)
0807 02:17:15.297749 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.297753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.297891 (+ 138us) server_negotiation.cc:407] Connection header received
0807 02:17:15.298025 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.298028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.298071 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.298151 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.298522 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34832: BlockingRecv error: recv got EOF from 127.0.0.1:34832 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 02:17:15.298825 1531 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786069003535869-1531-0/krb5kdc/krb5cc' of type FILE
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.299690 1531 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:15.300496 1531 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[9449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:17:15.308342 10169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:15.301273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.1.126.193:45653)
0807 02:17:15.301395 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:15.301399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:15.301512 (+ 113us) server_negotiation.cc:407] Connection header received
0807 02:17:15.301662 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:15.301665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:15.301707 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:15.301788 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:15.302254 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.302690 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.303454 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:15.303668 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:15.303770 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:15.305646 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:15.305649 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:15.305652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:15.305680 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:15.306859 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.307257 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.307261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.307263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.307339 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:15.307608 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:15.307611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:15.307613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:15.307762 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:15.307884 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:15.308109 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 02:17:15.308220 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:17:15.309190 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 9601
I20260807 02:17:15.321650 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 9791
I20260807 02:17:15.331607 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 9979
I20260807 02:17:15.344717 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 9464
2026-08-07T02:17:15Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2322 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[10184](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[10184](info): set up 2 sockets
Aug 07 02:17:15 dist-test-slave-39l8 krb5kdc[10184](info): commencing operation
krb5kdc: starting...
W20260807 02:17:16.547168 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:16 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab.
Entry for principal oryx/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab.
I20260807 02:17:16.666460 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36555
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab
--principal=oryx/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36555
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:16.775056 10204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:16.775300 10204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:16.775372 10204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:16.779258 10204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:16.779304 10204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:16.779323 10204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:16.779340 10204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:16.779397 10204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:16.784346 10204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab
--principal=oryx/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:16.785274 10204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:16.786253 10204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:16.794541 10204 server_base.cc:1034] running on GCE node
W20260807 02:17:16.794483 10216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:16.794494 10214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:16.794492 10211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:16.795298 10204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:16.796322 10204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:16.797489 10204 hybrid_clock.cc:648] HybridClock initialized: now 1786069036797475 us; error 26 us; skew 500 ppm
Aug 07 02:17:16 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:16.800180 10204 init.cc:377] Logged in from keytab as oryx/127.1.126.254@KRBTEST.COM (short username oryx)
I20260807 02:17:16.800997 10204 webserver.cc:460] Webserver started at http://127.1.126.254:39927/ using document root <none> and password file <none>
I20260807 02:17:16.801530 10204 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:16.801635 10204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:16.801858 10204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:16.803808 10204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "df7644d4c53b4cd59c52871a51a27edb"
format_stamp: "Formatted at 2026-08-07 02:17:16 on dist-test-slave-39l8"
server_key: "f5dd27487ee0bd1c9f25f8286bad416f"
server_key_iv: "40123260901fefedd2e305f3d557a8ca"
server_key_version: "encryptionkey@0"
I20260807 02:17:16.804360 10204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "df7644d4c53b4cd59c52871a51a27edb"
format_stamp: "Formatted at 2026-08-07 02:17:16 on dist-test-slave-39l8"
server_key: "f5dd27487ee0bd1c9f25f8286bad416f"
server_key_iv: "40123260901fefedd2e305f3d557a8ca"
server_key_version: "encryptionkey@0"
I20260807 02:17:16.807842 10204 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:16.810072 10228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:16.811245 10204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:17:16.811384 10204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "df7644d4c53b4cd59c52871a51a27edb"
format_stamp: "Formatted at 2026-08-07 02:17:16 on dist-test-slave-39l8"
server_key: "f5dd27487ee0bd1c9f25f8286bad416f"
server_key_iv: "40123260901fefedd2e305f3d557a8ca"
server_key_version: "encryptionkey@0"
I20260807 02:17:16.811491 10204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:16.822477 10204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:16.825117 10204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:16.825314 10204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:16.832309 10204 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36555
I20260807 02:17:16.832615 10309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36555 every 8 connection(s)
I20260807 02:17:16.833271 10204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:16.836007 10310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:16.841267 10310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Bootstrap starting.
I20260807 02:17:16.842015 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 10204
I20260807 02:17:16.842146 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:16.842487 1531 external_mini_cluster.cc:1428] Setting key dff70d6254ca9736b50fd20241876b45
I20260807 02:17:16.844257 10310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:16.844990 10310 log.cc:824] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:16.847136 10310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: No bootstrap required, opened a new log
Aug 07 02:17:16 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:16.851688 10310 raft_consensus.cc:348] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } }
I20260807 02:17:16.851923 10310 raft_consensus.cc:374] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:16.852021 10310 raft_consensus.cc:729] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7644d4c53b4cd59c52871a51a27edb, State: Initialized, Role: FOLLOWER
I20260807 02:17:16.852440 10310 consensus_queue.cc:260] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } }
I20260807 02:17:16.852589 10310 raft_consensus.cc:388] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:16.852684 10310 raft_consensus.cc:482] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:16.852787 10310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:16.853645 10310 raft_consensus.cc:504] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } }
I20260807 02:17:16.853997 10310 leader_election.cc:302] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df7644d4c53b4cd59c52871a51a27edb; no voters:
I20260807 02:17:16.854372 10310 leader_election.cc:288] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:16.854432 10318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:16.854635 10318 raft_consensus.cc:686] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 LEADER]: Becoming Leader. State: Replica: df7644d4c53b4cd59c52871a51a27edb, State: Running, Role: LEADER
I20260807 02:17:16.855008 10318 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } }
I20260807 02:17:16.855697 10310 sys_catalog.cc:564] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:16.856947 10320 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: New leader df7644d4c53b4cd59c52871a51a27edb. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } }
I20260807 02:17:16.857075 10320 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:16.857426 10319 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } }
I20260807 02:17:16.857509 10330 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:16.857589 10319 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:16.857817 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:16.843746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48618 (local address 127.1.126.254:36555)
0807 02:17:16.844166 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:16.844183 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:16.844217 (+ 34us) server_negotiation.cc:407] Connection header received
0807 02:17:16.844877 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:16.844894 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:16.845262 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:16.845629 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:16.846470 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:16.847536 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:16.848674 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:16.849136 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:16.849257 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:16.852151 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:16.852163 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:16.852176 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:16.852202 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:16.854278 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:16.854845 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:16.854851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:16.854857 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:16.854997 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:16.855299 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:16.855302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:16.855303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:16.855714 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:16.855910 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:16.856396 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 02:17:16.856769 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":142,"threads_started":1}
I20260807 02:17:16.861641 10330 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:16.867117 10330 catalog_manager.cc:1347] Generated new cluster ID: 6045c4315b5f4b038972cf3b3dab7d09
I20260807 02:17:16.867188 10330 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:16.889667 10330 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:16.890635 10330 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:16.896569 10330 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Generated new TSK 0
I20260807 02:17:16.897233 10330 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab.
Entry for principal oryx/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab.
I20260807 02:17:16.925751 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36555
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:17.037701 10345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:17.037997 10345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:17.038100 10345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:17.042229 10345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:17.042323 10345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:17.042414 10345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:17.047474 10345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:17.048434 10345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:17.049413 10345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:17.058696 10357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.058840 10345 server_base.cc:1034] running on GCE node
W20260807 02:17:17.058730 10355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.059032 10361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.059458 10345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:17.060021 10345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:17.061183 10345 hybrid_clock.cc:648] HybridClock initialized: now 1786069037061149 us; error 47 us; skew 500 ppm
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:17.063932 10345 init.cc:377] Logged in from keytab as oryx/127.1.126.193@KRBTEST.COM (short username oryx)
I20260807 02:17:17.064749 10345 webserver.cc:460] Webserver started at http://127.1.126.193:39801/ using document root <none> and password file <none>
I20260807 02:17:17.065359 10345 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:17.065421 10345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:17.065582 10345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:17.067500 10345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "f41e03dee44b4b6696b2a66a7ce096b6"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "95b0ffc88884e85c99b268910e207283"
server_key_iv: "a05e711317f7dc93f0a30c245b2b4c5f"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.067988 10345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "f41e03dee44b4b6696b2a66a7ce096b6"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "95b0ffc88884e85c99b268910e207283"
server_key_iv: "a05e711317f7dc93f0a30c245b2b4c5f"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.071673 10345 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:17.073953 10372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.075188 10345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:17.075304 10345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "f41e03dee44b4b6696b2a66a7ce096b6"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "95b0ffc88884e85c99b268910e207283"
server_key_iv: "a05e711317f7dc93f0a30c245b2b4c5f"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.075384 10345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:17.099795 10345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:17.102486 10345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:17.102643 10345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:17.103222 10345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:17.104000 10345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:17.104070 10345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.104110 10345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:17.104149 10345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.113107 10345 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:35993
I20260807 02:17:17.113276 10543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:35993 every 8 connection(s)
I20260807 02:17:17.113987 10345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:17.122398 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 10345
I20260807 02:17:17.122511 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:17.122864 1531 external_mini_cluster.cc:1428] Setting key bf9ad5e2a2aec276b39842bb240a58a9
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:17.127610 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.115859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:49349 (local address 127.1.126.254:36555)
0807 02:17:17.115979 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.115983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.117001 (+ 1018us) server_negotiation.cc:407] Connection header received
0807 02:17:17.117803 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.117805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.117855 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.117927 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.119166 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.119692 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.120719 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.120941 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.121036 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.123692 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.123696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.123698 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.123720 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.125317 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.125924 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.125927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.125928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.126005 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.126394 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.126396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.126397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.126630 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.126779 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.127251 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.127398 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 02:17:17.128225 10546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.116164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.193:49349)
0807 02:17:17.116857 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.116894 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.117614 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.118206 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.118213 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.118532 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.119018 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.119031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.119798 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.119800 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.120600 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.120609 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.121077 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.121080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.121238 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.121809 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.121824 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.123515 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.125438 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.125447 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.125463 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.125825 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.126105 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.126111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.126115 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.126298 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.126779 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.126787 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.127015 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.127174 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.127395 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":102,"threads_started":1}
I20260807 02:17:17.129401 10544 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36555
I20260807 02:17:17.129649 10544 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:17.130107 10544 heartbeater.cc:511] Master 127.1.126.254:36555 requested a full tablet report, sending...
I20260807 02:17:17.131914 10255 ts_manager.cc:194] Registered new tserver with Master: f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993)
I20260807 02:17:17.133060 10255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:49349
WARNING: no policy specified for oryx/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab.
Entry for principal oryx/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab.
I20260807 02:17:17.151194 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36555
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:17.263325 10550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:17.263538 10550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:17.263577 10550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:17.267310 10550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:17.267355 10550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:17.267407 10550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:17.272368 10550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:17.273224 10550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:17.274085 10550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:17.283061 10562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.283082 10561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.283056 10565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.283293 10550 server_base.cc:1034] running on GCE node
I20260807 02:17:17.283691 10550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:17.284271 10550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:17.285460 10550 hybrid_clock.cc:648] HybridClock initialized: now 1786069037285440 us; error 30 us; skew 500 ppm
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:17.288268 10550 init.cc:377] Logged in from keytab as oryx/127.1.126.194@KRBTEST.COM (short username oryx)
I20260807 02:17:17.289083 10550 webserver.cc:460] Webserver started at http://127.1.126.194:33193/ using document root <none> and password file <none>
I20260807 02:17:17.289638 10550 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:17.289731 10550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:17.289958 10550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:17.291975 10550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "d600874dc31c42e5bd499e68fd5b192a"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "35be5c33204fca50e7166926ae5a73ab"
server_key_iv: "3e42b7f92f6203f97ac889b596cd2471"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.292548 10550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "d600874dc31c42e5bd499e68fd5b192a"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "35be5c33204fca50e7166926ae5a73ab"
server_key_iv: "3e42b7f92f6203f97ac889b596cd2471"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.296017 10550 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:17.298273 10573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.299553 10550 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:17.299695 10550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "d600874dc31c42e5bd499e68fd5b192a"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "35be5c33204fca50e7166926ae5a73ab"
server_key_iv: "3e42b7f92f6203f97ac889b596cd2471"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.299799 10550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:17.324478 10550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:17.327684 10550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:17.327889 10550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:17.328483 10550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:17.329336 10550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:17.329411 10550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.329484 10550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:17.329527 10550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.338135 10550 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:39393
I20260807 02:17:17.338197 10728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:39393 every 8 connection(s)
I20260807 02:17:17.339075 10550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:17.347329 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 10550
I20260807 02:17:17.347472 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:17.347752 1531 external_mini_cluster.cc:1428] Setting key 1f9476190a65e07acd3c430c84705981
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:17.352350 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.340853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:34115 (local address 127.1.126.254:36555)
0807 02:17:17.341001 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.341006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.342040 (+ 1034us) server_negotiation.cc:407] Connection header received
0807 02:17:17.342913 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.342915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.342959 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.343028 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.344107 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.344597 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.345676 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.345876 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.345950 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.348500 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.348503 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.348505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.348553 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.350051 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.350651 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.350654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.350655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.350776 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.351156 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.351158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.351159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.351338 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.351413 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.351994 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.352141 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:17:17.352916 10731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.341266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:34115)
0807 02:17:17.341897 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.341936 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.342658 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.343216 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.343223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.343539 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.343970 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.343982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.344705 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.344708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.345567 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.345576 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.346014 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.346017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.346152 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.346764 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.346782 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.348314 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.350168 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.350174 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.350190 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.350551 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.350871 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.350877 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.350881 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.351059 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.351438 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.351447 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.351760 (+ 313us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.351909 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.352144 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":109,"threads_started":1}
I20260807 02:17:17.354032 10729 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36555
I20260807 02:17:17.354283 10729 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:17.354792 10729 heartbeater.cc:511] Master 127.1.126.254:36555 requested a full tablet report, sending...
I20260807 02:17:17.355902 10255 ts_manager.cc:194] Registered new tserver with Master: d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393)
I20260807 02:17:17.356637 10255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:34115
WARNING: no policy specified for oryx/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab.
Entry for principal oryx/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab.
I20260807 02:17:17.375703 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36555
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:17.486253 10734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:17.486476 10734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:17.486515 10734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:17.490262 10734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:17.490304 10734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:17.490355 10734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:17.495323 10734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:17.496220 10734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:17.497097 10734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:17.506935 10745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.506954 10747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.507115 10734 server_base.cc:1034] running on GCE node
W20260807 02:17:17.506930 10740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.507699 10734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:17.508235 10734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:17.509431 10734 hybrid_clock.cc:648] HybridClock initialized: now 1786069037509431 us; error 37 us; skew 500 ppm
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:17.512121 10734 init.cc:377] Logged in from keytab as oryx/127.1.126.195@KRBTEST.COM (short username oryx)
I20260807 02:17:17.512910 10734 webserver.cc:460] Webserver started at http://127.1.126.195:38131/ using document root <none> and password file <none>
I20260807 02:17:17.513444 10734 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:17.513537 10734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:17.513770 10734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:17.515813 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "c49c8bc1e5134088adc9c26143a6d8a8"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "b2c9efa29d6ac2a3639cec4c8611a7dc"
server_key_iv: "baf6013c6df44ce504b89dfd7c705f6a"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.516381 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "c49c8bc1e5134088adc9c26143a6d8a8"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "b2c9efa29d6ac2a3639cec4c8611a7dc"
server_key_iv: "baf6013c6df44ce504b89dfd7c705f6a"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.519982 10734 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:17.522199 10755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.523425 10734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:17.523566 10734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "c49c8bc1e5134088adc9c26143a6d8a8"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "b2c9efa29d6ac2a3639cec4c8611a7dc"
server_key_iv: "baf6013c6df44ce504b89dfd7c705f6a"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.523681 10734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:17.544476 10734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:17.547290 10734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:17.547493 10734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:17.548090 10734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:17.548919 10734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:17.548990 10734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.549062 10734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:17.549116 10734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.558558 10734 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:33303
I20260807 02:17:17.558624 10915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:33303 every 8 connection(s)
I20260807 02:17:17.559509 10734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:17.561642 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 10734
I20260807 02:17:17.561791 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:17.562073 1531 external_mini_cluster.cc:1428] Setting key 98e3c588b740e88949b6c666ac3b8df6
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:17.572574 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.561318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:46247 (local address 127.1.126.254:36555)
0807 02:17:17.561482 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.561488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.562661 (+ 1173us) server_negotiation.cc:407] Connection header received
0807 02:17:17.563626 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.563629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.563687 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.563765 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.564985 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.565551 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.566671 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.566939 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.567055 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.569343 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.569346 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.569348 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.569372 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.570875 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.571326 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.571328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.571329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.571404 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.571689 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.571691 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.571692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.571852 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.571927 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.572372 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.572461 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 02:17:17.573400 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.561719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:46247)
0807 02:17:17.562504 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.562555 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.563423 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.563928 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.563935 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.564385 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.564842 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.564855 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.565685 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.565696 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.566525 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.566534 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.567090 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.567095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.567261 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.567754 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.567770 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.569195 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.570974 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.570979 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.570989 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.571240 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.571478 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.571480 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.571482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.571608 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.571940 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.571944 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.572173 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.572322 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.572544 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":137,"threads_started":1}
I20260807 02:17:17.574425 10916 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36555
I20260807 02:17:17.574659 10916 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:17.575270 10916 heartbeater.cc:511] Master 127.1.126.254:36555 requested a full tablet report, sending...
I20260807 02:17:17.576323 10255 ts_manager.cc:194] Registered new tserver with Master: c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303)
I20260807 02:17:17.576871 10255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:46247
I20260807 02:17:17.587657 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.126.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.253.keytab.
Entry for principal oryx/127.1.126.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.253.keytab.
I20260807 02:17:17.613535 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:39787
--webserver_interface=127.1.126.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.253.keytab
--principal=oryx/127.1.126.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36555,127.1.126.253:39787
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:17.723598 10923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:17.723835 10923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:17.723928 10923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:17.727948 10923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:17.728000 10923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:17.728020 10923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:17.728075 10923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:17.728125 10923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:17.733598 10923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36555,127.1.126.253:39787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.253.keytab
--principal=oryx/127.1.126.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:39787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.126.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
W20260807 02:17:17.733832 10923 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.1.126.254:36555,127.1.126.253:39787'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 02:17:17.734733 10923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:17.735754 10923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:17.744048 10930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.744048 10935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.744086 10931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.744354 10923 server_base.cc:1034] running on GCE node
I20260807 02:17:17.744921 10923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:17.745954 10923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:17.747112 10923 hybrid_clock.cc:648] HybridClock initialized: now 1786069037747093 us; error 29 us; skew 500 ppm
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:17.749778 10923 init.cc:377] Logged in from keytab as oryx/127.1.126.253@KRBTEST.COM (short username oryx)
I20260807 02:17:17.750645 10923 webserver.cc:460] Webserver started at http://127.1.126.253:33137/ using document root <none> and password file <none>
I20260807 02:17:17.751278 10923 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:17.751343 10923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:17.751560 10923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:17.753592 10923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/instance:
uuid: "4665503e89fc4676888ff2a847089d82"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "665322b71180f1c2b1f18a11712b8005"
server_key_iv: "96650aa0def15028f407936886b91ed4"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.754156 10923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal/instance:
uuid: "4665503e89fc4676888ff2a847089d82"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "665322b71180f1c2b1f18a11712b8005"
server_key_iv: "96650aa0def15028f407936886b91ed4"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.758054 10923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:17:17.760448 10945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.761586 10923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:17.761722 10923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
uuid: "4665503e89fc4676888ff2a847089d82"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "665322b71180f1c2b1f18a11712b8005"
server_key_iv: "96650aa0def15028f407936886b91ed4"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.761826 10923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:17.780412 10923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:17.783257 10923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:17.783458 10923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:17.790485 10923 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.253:39787
I20260807 02:17:17.790827 11013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.253:39787 every 8 connection(s)
I20260807 02:17:17.791536 10923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
I20260807 02:17:17.794402 11016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:17.798249 11016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:17:17.799876 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 10923
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.253@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:17.811739 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.800149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48622 (local address 127.1.126.254:36555)
0807 02:17:17.800317 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.800323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.801262 (+ 939us) server_negotiation.cc:407] Connection header received
0807 02:17:17.802302 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.802306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.802362 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.802466 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.803373 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.803890 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.804954 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.805170 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.805278 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.807824 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.807827 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.807830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.807856 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.809439 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.810012 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.810016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.810017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.810104 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.810461 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.810465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.810467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.810697 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.810841 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.811444 (+ 603us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.811566 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:17:17.812603 11018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.800549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:48622)
0807 02:17:17.801082 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.801141 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.802046 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.802517 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.802523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.802923 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.803182 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.803196 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.804025 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.804028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.804820 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.804830 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.805313 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.805317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.805476 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.806045 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.806070 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.807624 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.809555 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.809564 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.809573 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.809894 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.810201 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.810204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.810206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.810360 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.810901 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.810909 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.811186 (+ 277us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.811387 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.811691 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":142,"threads_started":1}
I20260807 02:17:17.812604 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.800816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50120 (local address 127.1.126.253:39787)
0807 02:17:17.801270 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.801283 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.801324 (+ 41us) server_negotiation.cc:407] Connection header received
0807 02:17:17.802015 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.802031 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.802268 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.802472 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.803406 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.804239 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.805102 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.805445 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.805565 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.808273 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.808280 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.808293 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.808322 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.810046 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.810608 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.810613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.810614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.810695 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.811071 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.811074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.811076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.811329 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.811554 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.811769 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.811904 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":184,"threads_started":1}
I20260807 02:17:17.814718 11016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.253@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:17.821973 11018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.815132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50124)
0807 02:17:17.815262 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.815278 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.815380 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.815572 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.815574 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.815724 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.815792 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.815797 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.816456 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.816461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.816938 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.816945 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.817365 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.817368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.817529 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.817922 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.817932 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.819147 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.820772 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.820775 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.820776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.820948 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.821208 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.821210 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.821211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.821285 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.821602 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.821604 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.821675 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.821753 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.821841 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":55}
I20260807 02:17:17.822006 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.815170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50124 (local address 127.1.126.253:39787)
0807 02:17:17.815262 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.815267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.815346 (+ 79us) server_negotiation.cc:407] Connection header received
0807 02:17:17.815453 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.815457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.815488 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.815562 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.815891 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.816358 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.817047 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.817262 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.817368 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.819274 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.819277 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.819279 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.819300 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.820670 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.821032 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.821035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.821036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.821104 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.821369 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.821371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.821372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.821522 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.821597 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.821811 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.821894 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":39}
I20260807 02:17:17.825222 11016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Bootstrap starting.
I20260807 02:17:17.827646 11016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:17.828408 11016 log.cc:824] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:17.830269 11016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: No bootstrap required, opened a new log
I20260807 02:17:17.833719 11016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } }
I20260807 02:17:17.833984 11016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:17.834045 11016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4665503e89fc4676888ff2a847089d82, State: Initialized, Role: FOLLOWER
I20260807 02:17:17.834532 11016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } }
I20260807 02:17:17.835044 11029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } } }
I20260807 02:17:17.835184 11029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:17.835875 11016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 02:17:17.842299 11045 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:17:17.842447 11045 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:17:17.843194 10923 master_runner.cc:428] Detected that this master 4665503e89fc4676888ff2a847089d82 is joining an existing cluster
I20260807 02:17:17.843264 10923 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.126.253:39787
I20260807 02:17:17.854959 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.845663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48626 (local address 127.1.126.254:36555)
0807 02:17:17.845824 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.845829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.846099 (+ 270us) server_negotiation.cc:407] Connection header received
0807 02:17:17.846294 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.846300 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.846351 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.846403 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.847136 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.848039 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.849255 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.849461 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.849574 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.851211 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.851215 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.851218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.851247 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.852968 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.853560 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.853564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.853566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.853654 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.853958 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.853961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.853963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.854203 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.854309 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.854632 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.854798 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 02:17:17.855042 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.846285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50130 (local address 127.1.126.253:39787)
0807 02:17:17.846374 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.846378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.846566 (+ 188us) server_negotiation.cc:407] Connection header received
0807 02:17:17.846721 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.846724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.846758 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.846800 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.847371 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.847982 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.849243 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.849568 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.849700 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.851568 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.851572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.851575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.851599 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.853368 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.853831 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.853834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.853836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.853918 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.854185 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.854188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.854190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.854406 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.854506 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.854789 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.854887 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":34,"spinlock_wait_cycles":9216}
I20260807 02:17:17.854938 11051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.845576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:48626)
0807 02:17:17.845998 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.846013 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.846175 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.846567 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.846570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.846858 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.846991 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.846999 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.848167 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.848170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.849101 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.849109 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.849590 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.849594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.849715 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.850422 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.850433 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.851062 (+ 629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.853103 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.853106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.853108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.853419 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.853761 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.853764 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.853766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.853864 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.854313 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.854316 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.854423 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.854568 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.854736 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":176,"spinlock_wait_cycles":2432,"thread_start_us":103,"threads_started":1}
I20260807 02:17:17.855520 11053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.845960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50130)
0807 02:17:17.846498 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.846510 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.846615 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.846902 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.846904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.847108 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.847238 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.847245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.848088 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.848090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.849098 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.849109 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.849737 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.849740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.849949 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.850587 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.850600 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.851070 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.853483 (+ 2413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.853486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.853488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.853731 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.854014 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.854017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.854019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.854090 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.854506 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.854509 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.854592 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.854955 (+ 363us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.855081 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":78,"spinlock_wait_cycles":41856,"thread_start_us":133,"threads_started":1}
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.254@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:17.869782 11054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.860201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50140)
0807 02:17:17.860578 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.860634 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.860778 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.861059 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.861066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.861485 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.861616 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.861624 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.862284 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.862288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.863281 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.863293 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.863676 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.863679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.863805 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.864258 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.864273 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.866090 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.867834 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.867845 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.867850 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.868084 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.868444 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.868450 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.868452 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.868547 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.869038 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.869046 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.869198 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.869335 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.869537 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":91,"threads_started":1}
I20260807 02:17:17.870381 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.860239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50140 (local address 127.1.126.253:39787)
0807 02:17:17.860362 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.860367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.860721 (+ 354us) server_negotiation.cc:407] Connection header received
0807 02:17:17.860890 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.860892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.860933 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.860996 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.861733 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.862183 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.863389 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.863574 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.863650 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.866260 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.866263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.866265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.866290 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.867719 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.868211 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.868218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.868222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.868317 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.868681 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.868686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.868689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.868903 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.870112 (+ 1209us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.870194 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.870286 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:17:17.871634 10255 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.126.253:39787: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4665503e89fc4676888ff2a847089d82"
member_type: NON_VOTER
last_known_addr {
host: "127.1.126.253"
port: 39787
}
attrs {
promote: true
}
}
dest_uuid: "df7644d4c53b4cd59c52871a51a27edb"
cas_config_opid_index: -1
I20260807 02:17:17.872388 10255 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } }
I20260807 02:17:17.873939 11056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4665503e89fc4676888ff2a847089d82 (127.1.126.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } }
I20260807 02:17:17.874909 10978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:17.876139 11056 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.126.253:39787
I20260807 02:17:17.876300 10978 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Refusing update from remote peer df7644d4c53b4cd59c52871a51a27edb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 02:17:17.876603 10923 master.cc:537] Master@127.1.126.253:39787 shutting down...
WARNING: no policy specified for oryx/127.1.126.252@KRBTEST.COM; defaulting to no policy
I20260807 02:17:17.878423 11058 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.252@KRBTEST.COM" created.
I20260807 02:17:17.879593 11059 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } }
I20260807 02:17:17.879896 11059 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:17.881994 10923 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:17.882308 10923 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:17.882488 10923 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: stopping tablet replica
W20260807 02:17:17.883049 10231 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260807 02:17:17.887411 11054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.887151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50154)
0807 02:17:17.887271 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.887336 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:39787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 02:17:17.887636 10231 consensus_peers.cc:487] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb -> Peer 4665503e89fc4676888ff2a847089d82 (127.1.126.253:39787): Couldn't send request to peer 4665503e89fc4676888ff2a847089d82. Status: Network error: Client connection negotiation failed: client connection to 127.1.126.253:39787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.252.keytab.
Entry for principal oryx/127.1.126.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.252.keytab.
I20260807 02:17:17.897354 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:45001
--webserver_interface=127.1.126.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.252.keytab
--principal=oryx/127.1.126.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:17:17.897440 10923 master.cc:552] Master@127.1.126.253:39787 shutdown complete.
I20260807 02:17:17.897475 10923 master_runner.cc:305] Clearing existing system tablet
I20260807 02:17:17.897687 10923 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:17.897722 10923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:17.898815 10923 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 02:17:17.899801 11067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.900031 10923 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:17.900148 10923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:17.900182 10923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
uuid: "4665503e89fc4676888ff2a847089d82"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "665322b71180f1c2b1f18a11712b8005"
server_key_iv: "96650aa0def15028f407936886b91ed4"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.902406 10923 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:17.904909 10923 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 02:17:17.905001 10923 log.cc:1196] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 02:17:17.905292 10923 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Deleting consensus metadata
I20260807 02:17:17.905463 10923 master_runner.cc:315] Copying system tablet from 127.1.126.254:36555
I20260807 02:17:17.906842 10923 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: tablet copy: Beginning tablet copy session from remote peer at address 127.1.126.254:36555
I20260807 02:17:17.919576 11073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.907499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:48634)
0807 02:17:17.911139 (+ 3640us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:17.911155 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:17.911386 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:17.911718 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:17.911721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:17.911951 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:17.912098 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.912105 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.913188 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.913192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.914107 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:17.914118 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.914810 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.914815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:17.914916 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.915516 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:17.915530 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:17.915971 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:17.917945 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.917948 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.917951 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.918200 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.918494 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:17.918497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:17.918499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:17.918590 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:17.919026 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:17.919029 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:17.919130 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 02:17:17.919241 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 02:17:17.919373 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3547,"thread_start_us":94,"threads_started":1}
I20260807 02:17:17.919698 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:17.907600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.1.126.254:36555)
0807 02:17:17.907731 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:17.907736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:17.911290 (+ 3554us) server_negotiation.cc:407] Connection header received
0807 02:17:17.911520 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:17.911524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:17.911585 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:17.911678 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:17.912227 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.913069 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.914224 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:17.914627 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:17.914802 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:17.916103 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:17.916107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:17.916110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:17.916137 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:17.917828 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.918302 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.918307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.918310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.918397 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:17.918681 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:17.918685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:17.918686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:17.918928 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:17.919023 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:17.919310 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 02:17:17.919435 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:17:17.920727 10285 tablet_copy_service.cc:140] P df7644d4c53b4cd59c52871a51a27edb: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4665503e89fc4676888ff2a847089d82 ({username='oryx', principal='oryx/127.1.126.253@KRBTEST.COM'} at 127.0.0.1:48634)
I20260807 02:17:17.920930 10285 tablet_copy_service.cc:161] P df7644d4c53b4cd59c52871a51a27edb: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4665503e89fc4676888ff2a847089d82 at {username='oryx', principal='oryx/127.1.126.253@KRBTEST.COM'} at 127.0.0.1:48634: session id = 4665503e89fc4676888ff2a847089d82-00000000000000000000000000000000
I20260807 02:17:17.922976 10285 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 02:17:17.924822 10923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 02:17:17.927436 10923 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: tablet copy: Starting download of 0 data blocks...
I20260807 02:17:17.927636 10923 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: tablet copy: Starting download of 1 WAL segments...
I20260807 02:17:17.929469 10923 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 02:17:17.931357 10285 tablet_copy_service.cc:342] P df7644d4c53b4cd59c52871a51a27edb: Request end of tablet copy session 4665503e89fc4676888ff2a847089d82-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.126.253@KRBTEST.COM'} at 127.0.0.1:48634
I20260807 02:17:17.931479 10285 tablet_copy_service.cc:433] P df7644d4c53b4cd59c52871a51a27edb: ending tablet copy session 4665503e89fc4676888ff2a847089d82-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4665503e89fc4676888ff2a847089d82
I20260807 02:17:17.939356 10923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:17.941079 11078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:17.941262 11076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.941484 10923 server_base.cc:1034] running on GCE node
W20260807 02:17:17.941563 11074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:17.941802 10923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:17.942080 10923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:17.943210 10923 hybrid_clock.cc:648] HybridClock initialized: now 1786069037943193 us; error 32 us; skew 500 ppm
Aug 07 02:17:17 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069037, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:17.944964 10923 init.cc:377] Logged in from keytab as oryx/127.1.126.253@KRBTEST.COM (short username oryx)
I20260807 02:17:17.945452 10923 webserver.cc:460] Webserver started at http://127.1.126.253:41459/ using document root <none> and password file <none>
I20260807 02:17:17.945638 10923 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:17.945685 10923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:17.946982 10923 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:17.947988 11085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:17.948269 10923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:17.948344 10923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
uuid: "4665503e89fc4676888ff2a847089d82"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "665322b71180f1c2b1f18a11712b8005"
server_key_iv: "96650aa0def15028f407936886b91ed4"
server_key_version: "encryptionkey@0"
I20260807 02:17:17.948419 10923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:17.964478 10923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:17.966656 10923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:17.971469 10923 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.253:39787
I20260807 02:17:17.971650 11164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.253:39787 every 8 connection(s)
I20260807 02:17:17.972078 10923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
I20260807 02:17:17.973969 11165 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:17:17.975054 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Bootstrap starting.
I20260807 02:17:17.986421 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:17:17.986820 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: Bootstrap complete.
I20260807 02:17:17.987411 11165 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } }
I20260807 02:17:17.987568 11165 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4665503e89fc4676888ff2a847089d82, State: Initialized, Role: LEARNER
I20260807 02:17:17.987740 11165 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } }
I20260807 02:17:17.988114 11169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } }
I20260807 02:17:17.988248 11165 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:17.988298 11169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: LEARNER
I20260807 02:17:17.992534 11185 catalog_manager.cc:1259] Loaded cluster ID: 6045c4315b5f4b038972cf3b3dab7d09
I20260807 02:17:17.992606 11185 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: loading cluster ID for follower catalog manager: success
I20260807 02:17:17.994922 11185 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: acquiring CA information for follower catalog manager: success
I20260807 02:17:17.996619 11185 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 02:17:18.037487 11066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:18.037760 11066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:18.037838 11066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:18.041831 11066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:18.041882 11066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:18.041929 11066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:18.041960 11066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:18.041987 11066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:18.047271 11066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.252.keytab
--principal=oryx/127.1.126.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:45001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.126.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:18.048286 11066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:18.049304 11066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:18.057847 11195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:18.057821 11199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.058059 11066 server_base.cc:1034] running on GCE node
W20260807 02:17:18.057842 11196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.058794 11066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:18.059844 11066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:18.061036 11066 hybrid_clock.cc:648] HybridClock initialized: now 1786069038061016 us; error 32 us; skew 500 ppm
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:18.064049 11066 init.cc:377] Logged in from keytab as oryx/127.1.126.252@KRBTEST.COM (short username oryx)
I20260807 02:17:18.064888 11066 webserver.cc:460] Webserver started at http://127.1.126.252:44037/ using document root <none> and password file <none>
I20260807 02:17:18.065440 11066 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:18.065528 11066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:18.065766 11066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:18.067838 11066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/instance:
uuid: "56a3dbbaeb54445bbfd6fe9d38add934"
format_stamp: "Formatted at 2026-08-07 02:17:18 on dist-test-slave-39l8"
server_key: "7da9f7be7ce9fe330004083db8c275a5"
server_key_iv: "32b60edb37bd08d24dc5c6924a1475af"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.068403 11066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal/instance:
uuid: "56a3dbbaeb54445bbfd6fe9d38add934"
format_stamp: "Formatted at 2026-08-07 02:17:18 on dist-test-slave-39l8"
server_key: "7da9f7be7ce9fe330004083db8c275a5"
server_key_iv: "32b60edb37bd08d24dc5c6924a1475af"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.072131 11066 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:18.074486 11210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.075727 11066 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:17:18.075865 11066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
uuid: "56a3dbbaeb54445bbfd6fe9d38add934"
format_stamp: "Formatted at 2026-08-07 02:17:18 on dist-test-slave-39l8"
server_key: "7da9f7be7ce9fe330004083db8c275a5"
server_key_iv: "32b60edb37bd08d24dc5c6924a1475af"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.075969 11066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:18.085557 11066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:18.088264 11066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:18.088466 11066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:18.096822 11066 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.252:45001
I20260807 02:17:18.097151 11284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.252:45001 every 8 connection(s)
I20260807 02:17:18.097836 11066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
I20260807 02:17:18.100589 11285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:18.104689 11285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:17:18.107999 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 11066
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.252@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.126.252@KRBTEST.COM
I20260807 02:17:18.119614 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.106831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48638 (local address 127.1.126.254:36555)
0807 02:17:18.106972 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.106976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.107712 (+ 736us) server_negotiation.cc:407] Connection header received
0807 02:17:18.109042 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.109046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.109117 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.109219 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.110303 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.110892 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.111907 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.112137 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.112260 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.115888 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.115892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.115894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.115920 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.117736 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.118202 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.118207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.118209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.118303 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.118610 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.118614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.118616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.118861 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.118974 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.119327 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.119449 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 02:17:18.120464 11289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.108918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60122 (local address 127.1.126.252:45001)
0807 02:17:18.109264 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.109272 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.109291 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:17:18.109366 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.109369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.109514 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.109688 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.110483 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.111463 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.112293 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.112634 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.112769 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.115825 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.115833 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.115847 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.115873 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.117812 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.118244 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.118253 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.118257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.118388 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.118656 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.118661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.118663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.119048 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.119251 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.119479 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.119620 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"spinlock_wait_cycles":3456,"thread_start_us":174,"threads_started":1}
I20260807 02:17:18.120496 11288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.107096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:48638)
0807 02:17:18.107570 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.107611 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.108751 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.109401 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.109408 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.109728 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.110158 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.110170 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.111017 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.111025 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.111777 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.111787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.112290 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.112294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.112463 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.113125 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.113150 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.115763 (+ 2613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.117852 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.117860 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.117867 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.118085 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.118399 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.118401 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.118402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.118506 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.118971 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.118979 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.119106 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.119277 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.119563 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":22,"spinlock_wait_cycles":12160,"thread_start_us":107,"threads_started":1}
I20260807 02:17:18.121790 11285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.252@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:18.129331 11288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.122269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50168)
0807 02:17:18.122430 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.122444 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.122518 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.122879 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.122881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.123001 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.123121 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.123127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.123966 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.123968 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.124456 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.124463 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.124859 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.124861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.124932 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.125295 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.125306 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.126430 (+ 1124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.128130 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.128133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.128134 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.128314 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.128559 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.128560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.128562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.128634 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.128950 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.128952 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.129027 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.129136 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.129229 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260807 02:17:18.129455 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.122367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50168 (local address 127.1.126.253:39787)
0807 02:17:18.122631 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.122644 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.122657 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:18.122695 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.122698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.122789 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.122859 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.123226 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.123877 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.124550 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.124769 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.124841 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.126559 (+ 1718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.126562 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.126564 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.126586 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.128029 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.128403 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.128406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.128407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.128479 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.128712 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.128714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.128715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.128871 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.128945 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.129201 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.129311 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":101,"threads_started":1}
I20260807 02:17:18.130347 11285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.252@KRBTEST.COM for oryx/127.1.126.252@KRBTEST.COM
I20260807 02:17:18.135378 10544 heartbeater.cc:503] Master 127.1.126.254:36555 was elected leader, sending a full tablet report...
I20260807 02:17:18.137719 11288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.130893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.0.0.1:60134)
0807 02:17:18.131000 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.131013 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.131091 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.131325 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.131327 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.131475 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.131530 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.131534 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.132228 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.132234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.132700 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.132707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.133152 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.133155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.133233 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.133569 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.133579 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.134647 (+ 1068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.136491 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.136494 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.136495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.136744 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.136999 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.137001 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.137002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.137070 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.137367 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.137369 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.137434 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.137508 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.137596 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 02:17:18.137797 11289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.130893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60134 (local address 127.1.126.252:45001)
0807 02:17:18.131000 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.131005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.131054 (+ 49us) server_negotiation.cc:407] Connection header received
0807 02:17:18.131190 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.131193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.131227 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.131314 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.131633 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.132116 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.132807 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.133047 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.133152 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.134850 (+ 1698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.134852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.134854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.134875 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.136373 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.136818 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.136823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.136828 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.136919 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.137147 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.137149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.137150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.137291 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.137362 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.137537 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.137677 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":43}
I20260807 02:17:18.140770 11285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Bootstrap starting.
I20260807 02:17:18.143046 11285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:18.143766 11285 log.cc:824] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:18.145533 11285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: No bootstrap required, opened a new log
I20260807 02:17:18.148483 11285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } }
I20260807 02:17:18.148700 11285 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:18.148777 11285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a3dbbaeb54445bbfd6fe9d38add934, State: Initialized, Role: FOLLOWER
I20260807 02:17:18.149191 11285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } }
I20260807 02:17:18.149770 11292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } } }
I20260807 02:17:18.149892 11292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:18.150372 11285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 02:17:18.155484 11306 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:17:18.155588 11306 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:17:18.158878 11066 master_runner.cc:428] Detected that this master 56a3dbbaeb54445bbfd6fe9d38add934 is joining an existing cluster
I20260807 02:17:18.158942 11066 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.126.252:45001
I20260807 02:17:18.170635 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.160950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:48644)
0807 02:17:18.161281 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.161298 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.161405 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.161835 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.161842 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.162086 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.162253 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.162261 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.163367 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.163371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.164346 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.164357 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.165050 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.165053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.165139 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.165729 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.165742 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.166249 (+ 507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.168088 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.168094 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.168096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.168343 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.168684 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.168688 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.168691 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.168797 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.169274 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.169278 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.170155 (+ 877us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.170275 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.170402 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":50,"spinlock_wait_cycles":1792,"thread_start_us":123,"threads_started":1}
I20260807 02:17:18.170691 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.161008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.1.126.254:36555)
0807 02:17:18.161159 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.161164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.161370 (+ 206us) server_negotiation.cc:407] Connection header received
0807 02:17:18.161515 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.161518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.161601 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.161697 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.162392 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.163232 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.164469 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.164811 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.164885 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.166383 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.166387 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.166389 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.166421 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.167970 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.168454 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.168457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.168459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.168548 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.168903 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.168908 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.168910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.169142 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.169250 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.170364 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.170491 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 02:17:18.171806 11319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.161493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50174)
0807 02:17:18.161841 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.161856 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.162144 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.162517 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.162521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.162756 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.162876 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.162884 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.163929 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.163932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.166371 (+ 2439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.166385 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.167092 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.167095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.167200 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.167632 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.167647 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.168042 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.170062 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.170065 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.170066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.170317 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.170654 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.170657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.170659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.170771 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.171240 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.171244 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.171349 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.171497 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.171628 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":3,"spinlock_wait_cycles":4864,"thread_start_us":88,"threads_started":1}
I20260807 02:17:18.171819 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.161820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50174 (local address 127.1.126.253:39787)
0807 02:17:18.161940 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.161945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.162066 (+ 121us) server_negotiation.cc:407] Connection header received
0807 02:17:18.162272 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.162276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.162322 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.162372 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.163015 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.163785 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.166505 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.166868 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.166944 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.168225 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.168229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.168234 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.168266 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.169947 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.170438 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.170443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.170448 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.170535 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.170890 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.170893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.170895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.171077 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.171145 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.171551 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.171684 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:17:18.173517 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 10345
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069036, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.254@KRBTEST.COM for oryx/127.1.126.252@KRBTEST.COM
I20260807 02:17:18.187944 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:35993
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:36555
--webserver_port=39801
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:17:18.191088 11289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.162189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60148 (local address 127.1.126.252:45001)
0807 02:17:18.162287 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.162293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.162778 (+ 485us) server_negotiation.cc:407] Connection header received
0807 02:17:18.162907 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.162909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.162939 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.162977 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.163522 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.164244 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.165332 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.165629 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.165705 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.187253 (+ 21548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.187259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.187265 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.187299 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.189135 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.189807 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.189813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.189816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.189904 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.190192 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.190195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.190196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.190408 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.190479 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.190802 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.190921 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:17:18.191226 11054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.180459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.0.0.1:60164)
0807 02:17:18.180608 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.180626 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.180725 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.181070 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.181074 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.181267 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.181350 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.181356 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.182102 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.182107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.182650 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.182659 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.183194 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.183198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.183293 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.183754 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.183768 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.185015 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.189480 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.189486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.189488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.189778 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.190122 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.190128 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.190133 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.190227 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.190744 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.190750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.190845 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.190933 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.191059 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 02:17:18.191882 11322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.180518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60164 (local address 127.1.126.252:45001)
0807 02:17:18.180823 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.180834 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.180850 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:17:18.180905 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.180907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.180946 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.181052 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.181466 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.181991 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.182820 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.183074 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.183189 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.185182 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.185185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.185187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.185208 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.189349 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.189933 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.189938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.189942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.190016 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.190343 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.190346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.190347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.190592 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.191522 (+ 930us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.191594 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.191715 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"spinlock_wait_cycles":1280,"thread_start_us":135,"threads_started":1}
I20260807 02:17:18.192420 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.162383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.0.0.1:60148)
0807 02:17:18.162678 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.162691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.162828 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.163073 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.163076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.163298 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.163420 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.163427 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.164380 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.164386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.165205 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.165214 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.165830 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.165834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.165934 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.166704 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.166720 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.187093 (+ 20373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.189256 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.189260 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.189262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.189521 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.190005 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.190007 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.190010 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.190088 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.190536 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.190539 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.190617 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.191725 (+ 1108us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.191839 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":26,"spinlock_wait_cycles":4480,"thread_start_us":102,"threads_started":1}
I20260807 02:17:18.192971 10255 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.126.252:45001: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934"
member_type: NON_VOTER
last_known_addr {
host: "127.1.126.252"
port: 45001
}
attrs {
promote: true
}
}
dest_uuid: "df7644d4c53b4cd59c52871a51a27edb"
cas_config_opid_index: 5
I20260807 02:17:18.193661 10255 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } }
I20260807 02:17:18.195099 11056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.196702 11056 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.126.252:45001
I20260807 02:17:18.196875 11056 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.196962 11056 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.197494 11245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:18.199492 11245 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Refusing update from remote peer df7644d4c53b4cd59c52871a51a27edb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 02:17:18.200033 11054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.195255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50178)
0807 02:17:18.195410 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.195426 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.195503 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.196008 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.196011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.196031 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:18.196111 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.196117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.197167 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.197171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.198314 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.198326 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.199604 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.199608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.199704 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.199748 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.199828 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.199913 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 02:17:18.200389 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.195534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50178 (local address 127.1.126.253:39787)
0807 02:17:18.195687 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.195693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.195710 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:17:18.195772 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.195777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.195852 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.195969 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:18.196250 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.197020 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.198478 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.199262 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.199371 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.199536 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.200188 (+ 652us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.200280 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:17:18.200651 11059 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:18.200888 11124 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 LEARNER]: Refusing update from remote peer df7644d4c53b4cd59c52871a51a27edb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 02:17:18.201301 11061 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 02:17:18.201637 11066 master.cc:537] Master@127.1.126.252:45001 shutting down...
W20260807 02:17:18.202903 10235 consensus_peers.cc:487] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb -> Peer 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252:45001): Couldn't send request to peer 56a3dbbaeb54445bbfd6fe9d38add934. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 02:17:18.203837 11124 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.205449 11325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.205653 11325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: LEARNER
I20260807 02:17:18.205935 11169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df7644d4c53b4cd59c52871a51a27edb. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: NON_VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: true } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.206043 11169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: LEARNER
I20260807 02:17:18.208019 11061 raft_consensus.cc:1050] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: attempting to promote NON_VOTER 4665503e89fc4676888ff2a847089d82 to VOTER
I20260807 02:17:18.208525 11061 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } }
I20260807 02:17:18.210270 11066 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 02:17:18.210456 10235 consensus_peers.cc:487] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb -> Peer 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252:45001): Couldn't send request to peer 56a3dbbaeb54445bbfd6fe9d38add934. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 02:17:18.210536 11066 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:18.210623 11066 tablet_replica.cc:330] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: stopping tablet replica
I20260807 02:17:18.211288 11124 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 LEARNER]: Refusing update from remote peer df7644d4c53b4cd59c52871a51a27edb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 02:17:18.212100 11059 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 02:17:18.214444 11059 raft_consensus.cc:2932] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4665503e89fc4676888ff2a847089d82 (127.1.126.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.215888 11059 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.215992 11059 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.216149 11059 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.216223 11059 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.217024 11124 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4665503e89fc4676888ff2a847089d82 (127.1.126.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.218757 11169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.218880 11169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:18.220587 11066 master.cc:552] Master@127.1.126.252:45001 shutdown complete.
I20260807 02:17:18.220656 11066 master_runner.cc:305] Clearing existing system tablet
I20260807 02:17:18.220882 11066 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:18.220969 11066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:18.222041 11066 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 02:17:18.222981 11328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.223192 11066 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:18.223349 11066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:18.223387 11066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
uuid: "56a3dbbaeb54445bbfd6fe9d38add934"
format_stamp: "Formatted at 2026-08-07 02:17:18 on dist-test-slave-39l8"
server_key: "7da9f7be7ce9fe330004083db8c275a5"
server_key_iv: "32b60edb37bd08d24dc5c6924a1475af"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.224977 11066 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:18.227105 11066 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 02:17:18.227209 11066 log.cc:1196] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 02:17:18.227444 11066 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Deleting consensus metadata
I20260807 02:17:18.227638 11066 master_runner.cc:315] Copying system tablet from 127.1.126.254:36555
I20260807 02:17:18.228844 11066 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: tablet copy: Beginning tablet copy session from remote peer at address 127.1.126.254:36555
I20260807 02:17:18.238521 11337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.231069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:48652)
0807 02:17:18.231398 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.231410 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.231543 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.231809 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.231812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.232038 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.232142 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.232148 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.232905 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.232910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.233588 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.233597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.234074 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.234077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.234177 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.234789 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.234801 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.235123 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.236968 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.236971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.236974 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.237183 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.237474 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.237478 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.237481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.237567 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.237959 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.237963 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.238069 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.238181 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.238326 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":93,"threads_started":1}
I20260807 02:17:18.238512 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.231128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.1.126.254:36555)
0807 02:17:18.231267 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.231274 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.231495 (+ 221us) server_negotiation.cc:407] Connection header received
0807 02:17:18.231646 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.231650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.231705 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.231790 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.232262 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.232792 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.233721 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.233951 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.234057 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.235266 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.235269 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.235272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.235298 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.236835 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.237288 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.237292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.237293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.237380 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.237670 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.237674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.237676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.237858 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.237969 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.238240 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.238350 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:17:18.239344 10285 tablet_copy_service.cc:140] P df7644d4c53b4cd59c52871a51a27edb: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 56a3dbbaeb54445bbfd6fe9d38add934 ({username='oryx', principal='oryx/127.1.126.252@KRBTEST.COM'} at 127.0.0.1:48652)
I20260807 02:17:18.239457 10285 tablet_copy_service.cc:161] P df7644d4c53b4cd59c52871a51a27edb: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 56a3dbbaeb54445bbfd6fe9d38add934 at {username='oryx', principal='oryx/127.1.126.252@KRBTEST.COM'} at 127.0.0.1:48652: session id = 56a3dbbaeb54445bbfd6fe9d38add934-00000000000000000000000000000000
I20260807 02:17:18.240301 10285 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 02:17:18.241451 11066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 02:17:18.243353 11066 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: tablet copy: Starting download of 0 data blocks...
I20260807 02:17:18.243561 11066 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: tablet copy: Starting download of 1 WAL segments...
I20260807 02:17:18.244935 11066 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 02:17:18.246395 10285 tablet_copy_service.cc:342] P df7644d4c53b4cd59c52871a51a27edb: Request end of tablet copy session 56a3dbbaeb54445bbfd6fe9d38add934-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.126.252@KRBTEST.COM'} at 127.0.0.1:48652
I20260807 02:17:18.246490 10285 tablet_copy_service.cc:433] P df7644d4c53b4cd59c52871a51a27edb: ending tablet copy session 56a3dbbaeb54445bbfd6fe9d38add934-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 56a3dbbaeb54445bbfd6fe9d38add934
I20260807 02:17:18.253417 11066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:18.255107 11342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.255380 11066 server_base.cc:1034] running on GCE node
W20260807 02:17:18.255474 11338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:18.255803 11339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.256019 11066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:18.256352 11066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:18.259582 11066 hybrid_clock.cc:648] HybridClock initialized: now 1786069038259581 us; error 51 us; skew 500 ppm
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:18.261144 11066 init.cc:377] Logged in from keytab as oryx/127.1.126.252@KRBTEST.COM (short username oryx)
I20260807 02:17:18.261616 11066 webserver.cc:460] Webserver started at http://127.1.126.252:40265/ using document root <none> and password file <none>
I20260807 02:17:18.261811 11066 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:18.261868 11066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:18.263007 11066 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:18.263979 11352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.264201 11066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:18.264297 11066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
uuid: "56a3dbbaeb54445bbfd6fe9d38add934"
format_stamp: "Formatted at 2026-08-07 02:17:18 on dist-test-slave-39l8"
server_key: "7da9f7be7ce9fe330004083db8c275a5"
server_key_iv: "32b60edb37bd08d24dc5c6924a1475af"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.264379 11066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:18.288718 11066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:18.290962 11066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:18.295980 11066 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.252:45001
I20260807 02:17:18.295996 11436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.252:45001 every 8 connection(s)
I20260807 02:17:18.296550 11066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
I20260807 02:17:18.298025 11437 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:17:18.298950 11437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Bootstrap starting.
I20260807 02:17:18.307693 11437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:17:18.307976 11437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Bootstrap complete.
I20260807 02:17:18.308465 11437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } }
I20260807 02:17:18.308604 11437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 56a3dbbaeb54445bbfd6fe9d38add934, State: Initialized, Role: LEARNER
I20260807 02:17:18.308737 11437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } }
I20260807 02:17:18.309067 11444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.309234 11437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:18.309247 11444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: This master's current role is: LEARNER
I20260807 02:17:18.313097 11457 catalog_manager.cc:1259] Loaded cluster ID: 6045c4315b5f4b038972cf3b3dab7d09
I20260807 02:17:18.313177 11457 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: loading cluster ID for follower catalog manager: success
I20260807 02:17:18.314980 11457 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: acquiring CA information for follower catalog manager: success
I20260807 02:17:18.316148 11457 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 02:17:18.346226 11323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:18.346550 11323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:18.346624 11323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:18.352435 11323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:18.352531 11323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:18.352625 11323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:18.358794 10729 heartbeater.cc:503] Master 127.1.126.254:36555 was elected leader, sending a full tablet report...
I20260807 02:17:18.360512 11323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:35993
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=39801
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:18.361722 11323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:18.363098 11323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:18.375633 11467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:18.375653 11464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:18.375694 11465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.376082 11323 server_base.cc:1034] running on GCE node
I20260807 02:17:18.376470 11323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:18.377146 11323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:18.378345 11323 hybrid_clock.cc:648] HybridClock initialized: now 1786069038378312 us; error 40 us; skew 500 ppm
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:18.381534 11323 init.cc:377] Logged in from keytab as oryx/127.1.126.193@KRBTEST.COM (short username oryx)
I20260807 02:17:18.382411 11323 webserver.cc:460] Webserver started at http://127.1.126.193:39801/ using document root <none> and password file <none>
I20260807 02:17:18.383037 11323 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:18.383160 11323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:18.387017 11323 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 02:17:18.389117 11482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.390542 11323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:17:18.390673 11323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "f41e03dee44b4b6696b2a66a7ce096b6"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "95b0ffc88884e85c99b268910e207283"
server_key_iv: "a05e711317f7dc93f0a30c245b2b4c5f"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.391259 11323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:18.418864 11323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:18.422286 11323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:18.422510 11323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:18.423221 11323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:18.424080 11323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:18.424188 11323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.424281 11323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:18.424331 11323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.434456 11323 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:35993
I20260807 02:17:18.434494 11653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:35993 every 8 connection(s)
I20260807 02:17:18.435536 11323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:18.436386 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 11323
I20260807 02:17:18.436618 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 10550
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.252@KRBTEST.COM
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:18.463543 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.440066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:45113 (local address 127.1.126.254:36555)
0807 02:17:18.440258 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.440266 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.446640 (+ 6374us) server_negotiation.cc:407] Connection header received
0807 02:17:18.447837 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.447842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.447906 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.447960 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.449572 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.450297 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.451976 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.452313 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.452390 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.456070 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.456076 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.456082 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.456111 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.459395 (+ 3284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.460278 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.460281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.460283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.460374 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.461138 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.461145 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.461150 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.461440 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.461557 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.462945 (+ 1388us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.463324 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 02:17:18.464643 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.437782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.193:45113)
0807 02:17:18.446383 (+ 8601us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.446439 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.447607 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.448284 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.448294 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.448813 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.449417 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.449435 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.450508 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.450513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.451843 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.451858 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.452583 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.452589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.452798 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.453704 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.453730 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.455799 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.459528 (+ 3729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.459536 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.459556 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.460150 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.460793 (+ 643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.460797 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.460799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.460985 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.462168 (+ 1183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.462178 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.462530 (+ 352us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.462864 (+ 334us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.463313 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8383,"spinlock_wait_cycles":2944,"thread_start_us":847,"threads_started":1}
I20260807 02:17:18.465356 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.441804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:59005 (local address 127.1.126.252:45001)
0807 02:17:18.442513 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.442521 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.446881 (+ 4360us) server_negotiation.cc:407] Connection header received
0807 02:17:18.448016 (+ 1135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.448023 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.448139 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.448253 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.449646 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.451428 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.453378 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.453933 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.454117 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.458560 (+ 4443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.458567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.458574 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.458610 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.460677 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.461911 (+ 1234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.461917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.461922 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.462036 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.464103 (+ 2067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.464108 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.464109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.464373 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.464470 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.465030 (+ 560us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.465162 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":447,"threads_started":1}
I20260807 02:17:18.465847 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.454677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:53821 (local address 127.1.126.253:39787)
0807 02:17:18.454831 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.454837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.455159 (+ 322us) server_negotiation.cc:407] Connection header received
0807 02:17:18.455302 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.455306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.455359 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.455411 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.457526 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.458313 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.459572 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.459963 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.460052 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.462279 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.462285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.462292 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.462316 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.464017 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.464488 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.464493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.464496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.464581 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.464918 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.464922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.464923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.465135 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.465208 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.465571 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.465697 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 02:17:18.466210 11656 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36555
I20260807 02:17:18.466502 11656 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.466785 11661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.445460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.1.126.193:59005)
0807 02:17:18.446760 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.446775 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.447632 (+ 857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.448444 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.448450 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.448897 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.449425 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.449444 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.451623 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.451631 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.453183 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.453203 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.454304 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.454313 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.454546 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.455643 (+ 1097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.455669 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.458378 (+ 2709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.460827 (+ 2449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.460834 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.460839 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.461781 (+ 942us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.463137 (+ 1356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.463142 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.463145 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.463268 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.464511 (+ 1243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.464515 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.464609 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.464706 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.466095 (+ 1389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1212,"spinlock_wait_cycles":10368,"thread_start_us":520,"threads_started":1}
I20260807 02:17:18.467053 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:39393
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:36555
--webserver_port=33193
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:17:18.466974 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.453818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.1.126.193:53821)
0807 02:17:18.455033 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.455046 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.455155 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.455557 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.455561 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.456471 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.456624 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.456634 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.458470 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.458473 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.459438 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.459451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.460233 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.460239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.460341 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.460804 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.460831 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.462135 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.464132 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.464135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.464136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.464364 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.464718 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.464722 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.464724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.464820 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.465284 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.465287 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.465372 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.466045 (+ 673us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.466169 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"spinlock_wait_cycles":384,"thread_start_us":562,"threads_started":1}
I20260807 02:17:18.467185 11656 heartbeater.cc:511] Master 127.1.126.254:36555 requested a full tablet report, sending...
I20260807 02:17:18.468545 11655 heartbeater.cc:347] Connected to a master server at 127.1.126.252:45001
I20260807 02:17:18.468632 11657 heartbeater.cc:347] Connected to a master server at 127.1.126.253:39787
I20260807 02:17:18.468632 11655 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.468767 11657 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.468876 11655 heartbeater.cc:511] Master 127.1.126.252:45001 requested a full tablet report, sending...
I20260807 02:17:18.468892 10255 ts_manager.cc:194] Re-registered known tserver with Master: f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993)
I20260807 02:17:18.469000 11657 heartbeater.cc:511] Master 127.1.126.253:39787 requested a full tablet report, sending...
I20260807 02:17:18.469600 10255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:45113
I20260807 02:17:18.469951 11376 ts_manager.cc:194] Registered new tserver with Master: f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993)
I20260807 02:17:18.470227 11110 ts_manager.cc:194] Registered new tserver with Master: f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993)
I20260807 02:17:18.578862 10916 heartbeater.cc:503] Master 127.1.126.254:36555 was elected leader, sending a full tablet report...
W20260807 02:17:18.588158 11663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:18.588390 11663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:18.588433 11663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:18.592584 11663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:18.592634 11663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:18.592691 11663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:18.597872 11663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:39393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=33193
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:18.598829 11663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:18.599751 11663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:18.609099 11679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:18.609198 11674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.609237 11663 server_base.cc:1034] running on GCE node
W20260807 02:17:18.609123 11675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.609681 11663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:18.610334 11663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:18.611500 11663 hybrid_clock.cc:648] HybridClock initialized: now 1786069038611474 us; error 43 us; skew 500 ppm
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:18.614109 11663 init.cc:377] Logged in from keytab as oryx/127.1.126.194@KRBTEST.COM (short username oryx)
I20260807 02:17:18.615111 11663 webserver.cc:460] Webserver started at http://127.1.126.194:33193/ using document root <none> and password file <none>
I20260807 02:17:18.615703 11663 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:18.615803 11663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:18.619426 11663 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:18.621527 11688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.622746 11663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:18.622886 11663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "d600874dc31c42e5bd499e68fd5b192a"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "35be5c33204fca50e7166926ae5a73ab"
server_key_iv: "3e42b7f92f6203f97ac889b596cd2471"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.623420 11663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:18.646400 11663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:18.649142 11663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:18.649343 11663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:18.650038 11663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:18.650985 11663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:18.651057 11663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.651135 11663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:18.651178 11663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.660769 11663 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:39393
I20260807 02:17:18.660799 11847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:39393 every 8 connection(s)
I20260807 02:17:18.661720 11663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:18.665630 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 11663
I20260807 02:17:18.665798 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 10734
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:18.679826 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.663989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:52383 (local address 127.1.126.254:36555)
0807 02:17:18.664149 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.664154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.664657 (+ 503us) server_negotiation.cc:407] Connection header received
0807 02:17:18.665967 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.665973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.666035 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.666121 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.668125 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.668804 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.670417 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.670776 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.670885 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.674344 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.674350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.674355 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.674386 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.676468 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.677335 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.677341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.677346 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.677459 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.678018 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.678025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.678029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.678355 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.678474 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.679399 (+ 925us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.679559 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 02:17:18.681139 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.665201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:42815 (local address 127.1.126.253:39787)
0807 02:17:18.665329 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.665354 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.665428 (+ 74us) server_negotiation.cc:407] Connection header received
0807 02:17:18.665892 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.665898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.665960 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.666012 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.672260 (+ 6248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.673330 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.674972 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.675382 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.675464 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.677806 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.677812 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.677817 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.677847 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.679407 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.679845 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.679851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.679854 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.679926 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.680190 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.680205 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.680209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.680411 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.680472 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.680812 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.680934 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:17:18.681903 11857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.665071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.1.126.194:42815)
0807 02:17:18.665334 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.665345 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.665655 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.671732 (+ 6077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.671737 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.671941 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.672111 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.672120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.673510 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.673516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.674795 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.674812 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.675615 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.675620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.675745 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.676180 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.676208 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.677657 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.679531 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.679536 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.679540 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.679752 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.680021 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.680026 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.680030 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.680107 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.680538 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.680542 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.680649 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.681328 (+ 679us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.681479 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":85,"threads_started":1}
I20260807 02:17:18.681926 11855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.663978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:52383)
0807 02:17:18.664514 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.664564 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.665656 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.666433 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.666445 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.667088 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.667927 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.667954 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.668929 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.668934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.670265 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.670278 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.671379 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.671386 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.671593 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.672478 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.672501 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.674175 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.676643 (+ 2468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.676653 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.676674 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.677192 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.677614 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.677620 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.677625 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.677865 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.678546 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.678557 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.678996 (+ 439us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.680097 (+ 1101us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.680568 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"spinlock_wait_cycles":5248,"thread_start_us":160,"threads_started":1}
I20260807 02:17:18.683068 11850 heartbeater.cc:347] Connected to a master server at 127.1.126.253:39787
I20260807 02:17:18.683089 11849 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36555
I20260807 02:17:18.683347 11849 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.683351 11850 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.683909 11850 heartbeater.cc:511] Master 127.1.126.253:39787 requested a full tablet report, sending...
I20260807 02:17:18.683908 11849 heartbeater.cc:511] Master 127.1.126.254:36555 requested a full tablet report, sending...
I20260807 02:17:18.685184 11110 ts_manager.cc:194] Registered new tserver with Master: d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393)
I20260807 02:17:18.685179 10255 ts_manager.cc:194] Re-registered known tserver with Master: d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393)
I20260807 02:17:18.686203 10255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:52383
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.252@KRBTEST.COM
I20260807 02:17:18.695640 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.663710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:57817 (local address 127.1.126.252:45001)
0807 02:17:18.663882 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.663887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.664657 (+ 770us) server_negotiation.cc:407] Connection header received
0807 02:17:18.676632 (+ 11975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.676640 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.676727 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.676792 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.684799 (+ 8007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.685481 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.686281 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.686610 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.686746 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.690533 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.690538 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.690542 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.690583 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.692987 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.693652 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.693659 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.693663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.693768 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.694211 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.694218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.694222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.694511 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.694620 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.695149 (+ 529us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.695340 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 02:17:18.696414 11856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.663978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.1.126.194:57817)
0807 02:17:18.664514 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.664565 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.665655 (+ 1090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.684330 (+ 18675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.684333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.684544 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.684632 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.684643 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.685612 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.685615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.686146 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.686154 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.686793 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.686801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.686937 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.687536 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.687553 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.689603 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.693165 (+ 3562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.693171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.693176 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.693506 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.693912 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.693918 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.693923 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.694072 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.694735 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.694741 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.694869 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.695868 (+ 999us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.696101 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":65,"spinlock_wait_cycles":34816,"thread_start_us":196,"threads_started":1}
I20260807 02:17:18.697723 11848 heartbeater.cc:347] Connected to a master server at 127.1.126.252:45001
I20260807 02:17:18.697824 11848 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.698064 11848 heartbeater.cc:511] Master 127.1.126.252:45001 requested a full tablet report, sending...
I20260807 02:17:18.698902 11376 ts_manager.cc:194] Registered new tserver with Master: d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393)
I20260807 02:17:18.703794 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:33303
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:36555
--webserver_port=38131
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:17:18.769188 11859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.765098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.0.0.1:60166)
0807 02:17:18.765510 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.765523 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.765656 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.766002 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.766004 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.766023 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:18.766121 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.766125 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.767239 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.767242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.767975 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.767984 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.768860 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.768863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.768933 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.768956 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.769005 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.769063 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":90,"threads_started":1}
I20260807 02:17:18.769227 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.765261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60166 (local address 127.1.126.252:45001)
0807 02:17:18.765438 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.765443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.765583 (+ 140us) server_negotiation.cc:407] Connection header received
0807 02:17:18.765787 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.765790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.765856 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.765973 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:18.766223 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.767134 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.768102 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.768744 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.768850 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.768998 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.769043 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.769104 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:18.769951 11394 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 02:17:18.770376 11444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df7644d4c53b4cd59c52871a51a27edb. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.770550 11444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: This master's current role is: LEARNER
W20260807 02:17:18.817231 11858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:18.817445 11858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:18.817483 11858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:18.821277 11858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:18.821368 11858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:18.821471 11858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:18.826440 11858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:33303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=38131
--tserver_master_addrs=127.1.126.254:36555,127.1.126.253:39787,127.1.126.252:45001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:18.827441 11858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:18.828405 11858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:18.837976 11870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:18.837976 11872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.838243 11858 server_base.cc:1034] running on GCE node
W20260807 02:17:18.838275 11874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:18.838660 11858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:18.839347 11858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:18.840528 11858 hybrid_clock.cc:648] HybridClock initialized: now 1786069038840502 us; error 33 us; skew 500 ppm
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:18.843600 11858 init.cc:377] Logged in from keytab as oryx/127.1.126.195@KRBTEST.COM (short username oryx)
I20260807 02:17:18.844476 11858 webserver.cc:460] Webserver started at http://127.1.126.195:38131/ using document root <none> and password file <none>
I20260807 02:17:18.845046 11858 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:18.845162 11858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:18.849439 11858 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:18.851724 11886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.853009 11858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:18.853116 11858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "c49c8bc1e5134088adc9c26143a6d8a8"
format_stamp: "Formatted at 2026-08-07 02:17:17 on dist-test-slave-39l8"
server_key: "b2c9efa29d6ac2a3639cec4c8611a7dc"
server_key_iv: "baf6013c6df44ce504b89dfd7c705f6a"
server_key_version: "encryptionkey@0"
I20260807 02:17:18.853623 11858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:18.890765 11858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:18.893764 11858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:18.893919 11858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:18.894461 11858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:18.895458 11858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:18.895507 11858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.895576 11858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:18.895607 11858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:18.904837 11858 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:33303
I20260807 02:17:18.904872 12039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:33303 every 8 connection(s)
I20260807 02:17:18.905834 11858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:18.910634 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 11858
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.252@KRBTEST.COM
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
Aug 07 02:17:18 dist-test-slave-39l8 krb5kdc[10184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069038, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.253@KRBTEST.COM
I20260807 02:17:18.925402 12048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.908268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.1.126.195:56181)
0807 02:17:18.908857 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.908918 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.910076 (+ 1158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.912975 (+ 2899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.912981 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.913192 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.913405 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.913411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.914584 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.914589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.915437 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.915449 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.916247 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.916251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.916336 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.916768 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.916786 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.919745 (+ 2959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.921877 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.921882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.921900 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.922255 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.922597 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.922602 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.922605 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.922822 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.923361 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.923369 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.923711 (+ 342us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.923917 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.924269 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":102,"spinlock_wait_cycles":32256,"thread_start_us":144,"threads_started":1}
I20260807 02:17:18.925757 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.907729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:54349 (local address 127.1.126.254:36555)
0807 02:17:18.907858 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.907863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.909026 (+ 1163us) server_negotiation.cc:407] Connection header received
0807 02:17:18.910388 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.910392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.910461 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.910552 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.912064 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.912688 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.914635 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.915020 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.915102 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.920844 (+ 5742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.920849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.920852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.920883 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.922595 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.923566 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.923572 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.923575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.923660 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.924694 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.924699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.924702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.924954 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.925047 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.925439 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.925563 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:17:18.926236 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.907727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:56181 (local address 127.1.126.252:45001)
0807 02:17:18.907859 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.907863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.909024 (+ 1161us) server_negotiation.cc:407] Connection header received
0807 02:17:18.912713 (+ 3689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.912717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.912780 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.912832 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.913542 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.914353 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.915808 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.916130 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.916236 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.919912 (+ 3676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.919915 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.919918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.919942 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.921734 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.922377 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.922383 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.922388 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.922475 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.922944 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.922948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.922950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.923198 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.923296 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.925950 (+ 2654us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.926082 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:17:18.927194 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.913070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60170 (local address 127.1.126.252:45001)
0807 02:17:18.916607 (+ 3537us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.916614 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.916628 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:18.916676 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.916680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.916731 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.916820 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.917759 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.918611 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.919777 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.920133 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.920640 (+ 507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.922139 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.922146 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.922150 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.922176 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.924173 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.924685 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.924688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.924690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.924766 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.925225 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.925228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.925229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.925443 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.926820 (+ 1377us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.926936 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.927047 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3454,"thread_start_us":65,"threads_started":1}
I20260807 02:17:18.927224 12043 heartbeater.cc:347] Connected to a master server at 127.1.126.252:45001
I20260807 02:17:18.927495 12043 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.928131 12043 heartbeater.cc:511] Master 127.1.126.252:45001 requested a full tablet report, sending...
I20260807 02:17:18.929268 11376 ts_manager.cc:194] Registered new tserver with Master: c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303)
I20260807 02:17:18.929749 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.909515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:49987 (local address 127.1.126.253:39787)
0807 02:17:18.909639 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.909644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.909785 (+ 141us) server_negotiation.cc:407] Connection header received
0807 02:17:18.910294 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.910298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.910359 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.910430 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.912178 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.912887 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.914688 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.915078 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.915178 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.923893 (+ 8715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.923898 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.923901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.923928 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.925666 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.926296 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.926299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.926301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.926409 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.926839 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.926844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.926847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.927072 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.927159 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.929442 (+ 2283us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.929568 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:18.930351 12068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.915613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50194 (local address 127.1.126.253:39787)
0807 02:17:18.918197 (+ 2584us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.918201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.918214 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:18.918247 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.918251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.918296 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.918396 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.919379 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.920216 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.922183 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.922575 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.922692 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.926136 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.926140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.926142 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.926166 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.928115 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.928619 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.928627 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.928631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.928729 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.929088 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.929094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.929101 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.929343 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.929487 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.930030 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.930160 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2513,"thread_start_us":97,"threads_started":1}
I20260807 02:17:18.930372 12047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.908268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:54349)
0807 02:17:18.908857 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.908918 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.910076 (+ 1158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.910733 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.910738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.911280 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.911888 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.911909 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.912868 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.912871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.914489 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.914498 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.915292 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.915297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.915573 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.916598 (+ 1025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.916618 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.920713 (+ 4095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.923190 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.923195 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.923197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.923474 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.924456 (+ 982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.924459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.924461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.924561 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.925120 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.925123 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.925222 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.925912 (+ 690us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.930139 (+ 4227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":104,"spinlock_wait_cycles":7680,"thread_start_us":150,"threads_started":1}
I20260807 02:17:18.931242 12051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.909403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.1.126.195:49987)
0807 02:17:18.909685 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.909699 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.910084 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.910626 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.910633 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.911263 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:18.911887 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.911919 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.913250 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.913255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.914543 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.914556 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.915423 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.915427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.915581 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.916750 (+ 1169us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:18.916784 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:18.923517 (+ 6733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:18.925790 (+ 2273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.925796 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.925800 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.926176 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.926592 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:18.926595 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:18.926598 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:18.926698 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:18.929132 (+ 2434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:18.929135 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:18.929221 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.930034 (+ 813us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.931068 (+ 1034us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":961,"spinlock_wait_cycles":1664,"thread_start_us":114,"threads_started":1}
I20260807 02:17:18.931823 12044 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36555
I20260807 02:17:18.931906 12044 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.932117 12045 heartbeater.cc:347] Connected to a master server at 127.1.126.253:39787
I20260807 02:17:18.932120 12044 heartbeater.cc:511] Master 127.1.126.254:36555 requested a full tablet report, sending...
I20260807 02:17:18.932219 12045 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:18.932371 12045 heartbeater.cc:511] Master 127.1.126.253:39787 requested a full tablet report, sending...
I20260807 02:17:18.932500 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.913775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48662 (local address 127.1.126.254:36555)
0807 02:17:18.914453 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.914458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.915199 (+ 741us) server_negotiation.cc:407] Connection header received
0807 02:17:18.915242 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.915245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.915296 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.915378 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:18.916469 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.917278 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.918552 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.918891 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.918981 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.928031 (+ 9050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:18.928035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:18.928042 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:18.928064 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:18.930167 (+ 2103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.930627 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.930631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.930632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.930759 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:18.931018 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:18.931021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:18.931023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:18.931199 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:18.931367 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.932211 (+ 844us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.932348 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":67,"threads_started":1}
I20260807 02:17:18.932816 10255 ts_manager.cc:194] Re-registered known tserver with Master: c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303)
I20260807 02:17:18.933045 11110 ts_manager.cc:194] Registered new tserver with Master: c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303)
I20260807 02:17:18.933517 10255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:54349
I20260807 02:17:18.935381 10255 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:18.938303 10255 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:18.940814 11061 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: NON_VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: true } } }
I20260807 02:17:18.940943 11061 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.944121 12077 raft_consensus.cc:1050] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: attempting to promote NON_VOTER 56a3dbbaeb54445bbfd6fe9d38add934 to VOTER
I20260807 02:17:18.944454 12077 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } }
I20260807 02:17:18.945497 11394 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 LEARNER]: Refusing update from remote peer df7644d4c53b4cd59c52871a51a27edb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 02:17:18.945744 11124 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Refusing update from remote peer df7644d4c53b4cd59c52871a51a27edb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 02:17:18.945953 12076 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 02:17:18.946434 12076 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 02:17:18.947662 12074 raft_consensus.cc:2932] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.948071 11394 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.948429 11124 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.949916 11444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.950062 11444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:18.950450 12076 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.950593 12076 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.950829 12074 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.950924 12074 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.950888 12077 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.951023 12077 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:18.951174 12091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df7644d4c53b4cd59c52871a51a27edb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:18.951288 12091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:18.959600 11859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.953887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39393 (local address 127.0.0.1:48726)
0807 02:17:18.954041 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.954056 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.954132 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.955538 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.955541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.955558 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:18.955687 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.955695 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.956829 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.956833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.958027 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.958039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.959176 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.959180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.959288 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.959314 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.959396 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.959463 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":3}
I20260807 02:17:18.959647 12093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.954340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48726 (local address 127.1.126.194:39393)
0807 02:17:18.955148 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.955157 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.955182 (+ 25us) server_negotiation.cc:407] Connection header received
0807 02:17:18.955245 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.955249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.955404 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.955568 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:18.955838 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.956736 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.958174 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.959052 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.959162 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.959308 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.959424 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.959509 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":113,"threads_started":1}
I20260807 02:17:18.961261 12092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.954228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35993 (local address 127.0.0.1:57352)
0807 02:17:18.954498 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.954513 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.954610 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.957043 (+ 2433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.957046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.957067 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:18.957152 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.957157 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.958610 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.958615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.959702 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.959715 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.960856 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.960859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.960944 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.960969 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.961047 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.961129 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":49,"thread_start_us":118,"threads_started":1}
I20260807 02:17:18.961521 12095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.954578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:33303 (local address 127.0.0.1:36096)
0807 02:17:18.954848 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:18.954864 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:18.954955 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:18.956219 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:18.956222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:18.956239 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:18.956321 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.956329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.958793 (+ 2464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.958797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.960118 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:18.960128 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.961148 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.961152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:18.961237 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.961260 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:17:18.961338 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 02:17:18.961401 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":20,"thread_start_us":95,"threads_started":1}
I20260807 02:17:18.961720 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.954893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57352 (local address 127.1.126.193:35993)
0807 02:17:18.956543 (+ 1650us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.956556 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.956597 (+ 41us) server_negotiation.cc:407] Connection header received
0807 02:17:18.956671 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.956674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.956896 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.957068 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:18.957266 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.958463 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.959808 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.960551 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.960652 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.960779 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.961441 (+ 662us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.961552 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1515,"thread_start_us":71,"threads_started":1}
I20260807 02:17:18.962445 12098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:18.954751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36096 (local address 127.1.126.195:33303)
0807 02:17:18.955853 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:18.955871 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:18.955888 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:17:18.955945 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:18.955948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:18.956083 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:18.956238 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:18.957225 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.958277 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.960259 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:18.961011 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:18.961123 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:18.961245 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:18.961722 (+ 477us) server_negotiation.cc:299] Negotiation successful
0807 02:17:18.962339 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1004,"thread_start_us":94,"threads_started":1}
I20260807 02:17:18.962709 11752 tablet_service.cc:1467] Processing CreateTablet for tablet dab9104d7b824a8e84c2dc7c8176b5cc (DEFAULT_TABLE table=test-table [id=2988cc2aee2648c687af0a0e61ca9efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:18.963886 11752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab9104d7b824a8e84c2dc7c8176b5cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:18.964286 11560 tablet_service.cc:1467] Processing CreateTablet for tablet dab9104d7b824a8e84c2dc7c8176b5cc (DEFAULT_TABLE table=test-table [id=2988cc2aee2648c687af0a0e61ca9efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:18.964574 11947 tablet_service.cc:1467] Processing CreateTablet for tablet dab9104d7b824a8e84c2dc7c8176b5cc (DEFAULT_TABLE table=test-table [id=2988cc2aee2648c687af0a0e61ca9efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:18.965397 11560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab9104d7b824a8e84c2dc7c8176b5cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:18.965567 11947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab9104d7b824a8e84c2dc7c8176b5cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:18.973095 12104 tablet_bootstrap.cc:492] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Bootstrap starting.
I20260807 02:17:18.973951 12106 tablet_bootstrap.cc:492] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Bootstrap starting.
I20260807 02:17:18.975047 12103 tablet_bootstrap.cc:492] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Bootstrap starting.
I20260807 02:17:18.975235 12104 tablet_bootstrap.cc:654] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:18.975906 12106 tablet_bootstrap.cc:654] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:18.976028 12104 log.cc:824] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:18.976699 12106 log.cc:824] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:18.977035 12103 tablet_bootstrap.cc:654] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:18.977900 12103 log.cc:824] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:18.977953 12104 tablet_bootstrap.cc:492] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: No bootstrap required, opened a new log
I20260807 02:17:18.978124 12104 ts_tablet_manager.cc:1397] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 02:17:18.979408 12106 tablet_bootstrap.cc:492] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: No bootstrap required, opened a new log
I20260807 02:17:18.979566 12106 ts_tablet_manager.cc:1397] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260807 02:17:18.980275 12103 tablet_bootstrap.cc:492] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: No bootstrap required, opened a new log
I20260807 02:17:18.980450 12103 ts_tablet_manager.cc:1397] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 02:17:18.982125 12104 raft_consensus.cc:348] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:18.982375 12104 raft_consensus.cc:374] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:18.982430 12104 raft_consensus.cc:729] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f41e03dee44b4b6696b2a66a7ce096b6, State: Initialized, Role: FOLLOWER
I20260807 02:17:18.982929 12104 consensus_queue.cc:260] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:18.983847 12104 ts_tablet_manager.cc:1428] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:17:18.984196 11656 heartbeater.cc:503] Master 127.1.126.254:36555 was elected leader, sending a full tablet report...
I20260807 02:17:18.985162 12103 raft_consensus.cc:348] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:18.985399 12103 raft_consensus.cc:374] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:18.985448 12103 raft_consensus.cc:729] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49c8bc1e5134088adc9c26143a6d8a8, State: Initialized, Role: FOLLOWER
I20260807 02:17:18.985893 12103 consensus_queue.cc:260] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:18.987121 12103 ts_tablet_manager.cc:1428] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 02:17:18.987136 12106 raft_consensus.cc:348] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:18.987484 12106 raft_consensus.cc:374] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:18.987524 12044 heartbeater.cc:503] Master 127.1.126.254:36555 was elected leader, sending a full tablet report...
I20260807 02:17:18.987555 12106 raft_consensus.cc:729] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d600874dc31c42e5bd499e68fd5b192a, State: Initialized, Role: FOLLOWER
I20260807 02:17:18.987959 12106 consensus_queue.cc:260] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:18.988853 12106 ts_tablet_manager.cc:1428] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260807 02:17:18.990046 11849 heartbeater.cc:503] Master 127.1.126.254:36555 was elected leader, sending a full tablet report...
I20260807 02:17:19.043021 12114 raft_consensus.cc:482] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:19.043226 12114 raft_consensus.cc:504] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:19.044359 12114 leader_election.cc:288] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993), c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303)
I20260807 02:17:19.048067 12098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.044966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:52161 (local address 127.1.126.195:33303)
0807 02:17:19.045107 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.045113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.045127 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:19.045176 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.045179 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.045225 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.045304 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:19.045560 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.046061 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.047087 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.047479 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.047606 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.047670 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.047872 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.047939 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:17:19.048082 11856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.044551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35993 (local address 127.1.126.194:47377)
0807 02:17:19.044724 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:19.044739 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:19.044860 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:19.045181 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:19.045184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:19.045202 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:19.045322 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:19.045327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.046090 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.046095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:19.046955 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:19.046964 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.047592 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.047595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:19.047718 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.047736 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 02:17:19.047823 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 02:17:19.047904 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":1}
I20260807 02:17:19.048067 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.044677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:47377 (local address 127.1.126.193:35993)
0807 02:17:19.044818 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.044823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.044840 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:17:19.045012 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.045015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.045067 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.045162 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:19.045432 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.045976 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.047077 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.047474 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.047603 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.047655 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.047841 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.047911 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:17:19.048096 11857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.044857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:33303 (local address 127.1.126.194:52161)
0807 02:17:19.044952 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:19.044967 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:19.045047 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:19.045325 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:19.045328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:19.045344 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:19.045453 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:19.045458 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.046179 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.046184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:19.046967 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:19.046977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.047601 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.047605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:19.047748 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.047767 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 02:17:19.047854 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 02:17:19.047923 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":23}
I20260807 02:17:19.048871 11977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab9104d7b824a8e84c2dc7c8176b5cc" candidate_uuid: "d600874dc31c42e5bd499e68fd5b192a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" is_pre_election: true
I20260807 02:17:19.048877 11591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab9104d7b824a8e84c2dc7c8176b5cc" candidate_uuid: "d600874dc31c42e5bd499e68fd5b192a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" is_pre_election: true
I20260807 02:17:19.049153 11591 raft_consensus.cc:2454] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d600874dc31c42e5bd499e68fd5b192a in term 0.
I20260807 02:17:19.049162 11977 raft_consensus.cc:2454] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d600874dc31c42e5bd499e68fd5b192a in term 0.
I20260807 02:17:19.049672 11694 leader_election.cc:302] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d600874dc31c42e5bd499e68fd5b192a, f41e03dee44b4b6696b2a66a7ce096b6; no voters:
I20260807 02:17:19.049974 12114 raft_consensus.cc:2781] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:19.050086 12114 raft_consensus.cc:482] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:19.050164 12114 raft_consensus.cc:3037] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:19.051306 12114 raft_consensus.cc:504] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:19.051644 12114 leader_election.cc:288] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [CANDIDATE]: Term 1 election: Requested vote from peers f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993), c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303)
I20260807 02:17:19.052050 11591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab9104d7b824a8e84c2dc7c8176b5cc" candidate_uuid: "d600874dc31c42e5bd499e68fd5b192a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f41e03dee44b4b6696b2a66a7ce096b6"
I20260807 02:17:19.052152 11591 raft_consensus.cc:3037] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:19.053104 11591 raft_consensus.cc:2454] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d600874dc31c42e5bd499e68fd5b192a in term 1.
I20260807 02:17:19.053359 11977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab9104d7b824a8e84c2dc7c8176b5cc" candidate_uuid: "d600874dc31c42e5bd499e68fd5b192a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49c8bc1e5134088adc9c26143a6d8a8"
I20260807 02:17:19.053383 11694 leader_election.cc:302] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d600874dc31c42e5bd499e68fd5b192a, f41e03dee44b4b6696b2a66a7ce096b6; no voters:
I20260807 02:17:19.053511 11977 raft_consensus.cc:3037] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:19.053570 12114 raft_consensus.cc:2781] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:19.053771 12114 raft_consensus.cc:686] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 1 LEADER]: Becoming Leader. State: Replica: d600874dc31c42e5bd499e68fd5b192a, State: Running, Role: LEADER
I20260807 02:17:19.054423 12114 consensus_queue.cc:237] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } }
I20260807 02:17:19.054844 11977 raft_consensus.cc:2454] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d600874dc31c42e5bd499e68fd5b192a in term 1.
I20260807 02:17:19.058034 10253 catalog_manager.cc:5495] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a reported cstate change: term changed from 0 to 1, leader changed from <none> to d600874dc31c42e5bd499e68fd5b192a (127.1.126.194). New cstate: current_term: 1 leader_uuid: "d600874dc31c42e5bd499e68fd5b192a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } health_report { overall_health: UNKNOWN } } }
I20260807 02:17:19.086374 12093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.083283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48738 (local address 127.1.126.194:39393)
0807 02:17:19.083407 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.083411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.083424 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:19.083496 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.083499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.083549 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.083637 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:19.083846 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.084325 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.085101 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.085298 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.085371 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.085632 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:19.086012 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:19.086098 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.086165 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.086209 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:17:19.092419 11977 raft_consensus.cc:1261] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Refusing update from remote peer d600874dc31c42e5bd499e68fd5b192a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:19.092422 11591 raft_consensus.cc:1261] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Refusing update from remote peer d600874dc31c42e5bd499e68fd5b192a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:19.093132 12114 consensus_queue.cc:1035] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:19.093358 12116 consensus_queue.cc:1035] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:19.105268 12124 mvcc.cc:205] Tried to move back new op lower bound from 7315738784115150848 to 7315738783970091008. Current Snapshot: MvccSnapshot[applied={T|T < 7315738784115150848}]
I20260807 02:17:19.110671 12125 mvcc.cc:205] Tried to move back new op lower bound from 7315738784115150848 to 7315738783970091008. Current Snapshot: MvccSnapshot[applied={T|T < 7315738784115150848 or (T in {7315738784115150848})}]
I20260807 02:17:19.110706 10255 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:19.110872 10255 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:19.115123 10255 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df7644d4c53b4cd59c52871a51a27edb: Sending DeleteTablet for 3 replicas of tablet dab9104d7b824a8e84c2dc7c8176b5cc
I20260807 02:17:19.115883 11752 tablet_service.cc:1514] Processing DeleteTablet for tablet dab9104d7b824a8e84c2dc7c8176b5cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:19 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:48726
I20260807 02:17:19.116266 11560 tablet_service.cc:1514] Processing DeleteTablet for tablet dab9104d7b824a8e84c2dc7c8176b5cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:19 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:57352
I20260807 02:17:19.116317 11947 tablet_service.cc:1514] Processing DeleteTablet for tablet dab9104d7b824a8e84c2dc7c8176b5cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:19 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:36096
I20260807 02:17:19.116393 12134 tablet_replica.cc:330] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: stopping tablet replica
I20260807 02:17:19.116676 12134 raft_consensus.cc:2229] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:19.116984 12134 raft_consensus.cc:2258] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:19.118613 12134 ts_tablet_manager.cc:1905] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:19.118939 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 10204
I20260807 02:17:19.128679 12134 ts_tablet_manager.cc:1918] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:19.128789 12134 log.cc:1196] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/dab9104d7b824a8e84c2dc7c8176b5cc
I20260807 02:17:19.129137 12134 ts_tablet_manager.cc:1939] T dab9104d7b824a8e84c2dc7c8176b5cc P d600874dc31c42e5bd499e68fd5b192a: Deleting consensus metadata
I20260807 02:17:19.136739 12136 tablet_replica.cc:330] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: stopping tablet replica
W20260807 02:17:19.136756 11690 connection.cc:535] server connection from 127.0.0.1:48726 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 02:17:19.137066 12136 raft_consensus.cc:2229] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:19.137394 12136 raft_consensus.cc:2258] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:19.137778 12137 tablet_replica.cc:330] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: stopping tablet replica
I20260807 02:17:19.138049 12137 raft_consensus.cc:2229] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:19.138321 12137 raft_consensus.cc:2258] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:19.139498 12136 ts_tablet_manager.cc:1905] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:19.142274 12136 ts_tablet_manager.cc:1918] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:19.142379 12136 log.cc:1196] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/dab9104d7b824a8e84c2dc7c8176b5cc
I20260807 02:17:19.142849 12136 ts_tablet_manager.cc:1939] T dab9104d7b824a8e84c2dc7c8176b5cc P f41e03dee44b4b6696b2a66a7ce096b6: Deleting consensus metadata
I20260807 02:17:19.143285 12137 ts_tablet_manager.cc:1905] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 02:17:19.144016 11485 connection.cc:441] server connection from 127.0.0.1:57352 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57352 (request call id 1) could send its response
I20260807 02:17:19.146812 12137 ts_tablet_manager.cc:1918] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:19.146917 12137 log.cc:1196] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/dab9104d7b824a8e84c2dc7c8176b5cc
I20260807 02:17:19.147930 12137 ts_tablet_manager.cc:1939] T dab9104d7b824a8e84c2dc7c8176b5cc P c49c8bc1e5134088adc9c26143a6d8a8: Deleting consensus metadata
W20260807 02:17:19.150880 11888 connection.cc:441] server connection from 127.0.0.1:36096 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36096 (request call id 1) could send its response
I20260807 02:17:19.153244 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.141550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60182 (local address 127.1.126.252:45001)
0807 02:17:19.141659 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.141664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.142630 (+ 966us) server_negotiation.cc:407] Connection header received
0807 02:17:19.142901 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.142904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.142952 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.143002 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:19.144255 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.144970 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.146089 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.146438 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.146514 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.148723 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:19.148727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:19.148729 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:19.148756 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:19.150695 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.151157 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.151162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.151165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.151277 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.152167 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.152172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.152175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.152414 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:19.152546 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.152914 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.153042 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:17:19.154220 12068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.118167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50210 (local address 127.1.126.253:39787)
0807 02:17:19.118494 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.118498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.137666 (+ 19168us) server_negotiation.cc:407] Connection header received
0807 02:17:19.137954 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.137959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.138016 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.138072 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:19.139314 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.140028 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.142487 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.142928 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.143029 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.149346 (+ 6317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:19.149353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:19.149356 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:19.149383 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:19.152375 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.152923 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.152927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.152929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.153023 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.153336 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.153339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.153341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.153535 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:19.153636 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.153942 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.154055 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":257,"spinlock_wait_cycles":3968}
I20260807 02:17:19.154415 11290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.141071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50224 (local address 127.1.126.253:39787)
0807 02:17:19.141185 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.141189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.144436 (+ 3247us) server_negotiation.cc:407] Connection header received
0807 02:17:19.144584 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.144614 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.144668 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.144715 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:19.145579 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.146362 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.147565 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.147907 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.147977 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.150280 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:19.150283 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:19.150286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:19.150311 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:19.152325 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.152865 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.152870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.152871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.152953 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.153277 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.153283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.153284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.153488 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:19.153591 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.154171 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.154285 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 02:17:19.162685 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:19.117955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60178 (local address 127.1.126.252:45001)
0807 02:17:19.118281 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:19.118285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:19.154648 (+ 36363us) server_negotiation.cc:407] Connection header received
0807 02:17:19.154875 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:19.154878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:19.154922 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:19.154967 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:19.155753 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.156260 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.157337 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:19.157608 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:19.157697 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:19.159195 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:19.159198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:19.159200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:19.159221 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:19.160646 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.161106 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.161111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.161113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.161222 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:19.161703 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:19.161707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:19.161708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:19.161912 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:19.162015 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:19.162400 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 02:17:19.162526 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260807 02:17:20.107091 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.106566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.193:53379)
0807 02:17:20.106889 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.106994 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":84,"threads_started":1}
W20260807 02:17:20.107496 11656 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36555 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.108213 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.107829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:53245)
0807 02:17:20.108052 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.108132 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":93,"threads_started":1}
W20260807 02:17:20.108477 11849 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36555 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.111815 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.111455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:52631)
0807 02:17:20.111668 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.111740 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":57,"threads_started":1}
W20260807 02:17:20.112076 12044 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36555 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.616634 12153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df7644d4c53b4cd59c52871a51a27edb)
I20260807 02:17:20.616832 12153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } }
I20260807 02:17:20.617875 12153 leader_election.cc:288] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555), 4665503e89fc4676888ff2a847089d82 (127.1.126.253:39787)
I20260807 02:17:20.618384 12155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.617974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49186)
0807 02:17:20.618183 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.618285 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":64,"threads_started":1}
I20260807 02:17:20.618723 12158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df7644d4c53b4cd59c52871a51a27edb)
W20260807 02:17:20.618685 11354 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.618892 12158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } }
I20260807 02:17:20.619583 12155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.619349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49188)
0807 02:17:20.619463 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.619515 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 02:17:20.619696 11354 leader_election.cc:334] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555): Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.620354 12160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.619940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49190)
0807 02:17:20.620174 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.620240 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":91,"threads_started":1}
W20260807 02:17:20.620802 11087 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.621104 12158 leader_election.cc:288] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555), 56a3dbbaeb54445bbfd6fe9d38add934 (127.1.126.252:45001)
I20260807 02:17:20.621824 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.621550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49204)
0807 02:17:20.621703 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.621758 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260807 02:17:20.621927 11087 leader_election.cc:334] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555): Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.623526 12157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.618390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50226 (local address 127.1.126.253:39787)
0807 02:17:20.618817 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.618822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.619201 (+ 379us) server_negotiation.cc:407] Connection header received
0807 02:17:20.619557 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.619567 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.619610 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.619710 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.620058 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.620964 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.622460 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.622988 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.623110 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.623170 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.623348 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.623419 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":347,"thread_start_us":76,"threads_started":1}
I20260807 02:17:20.623529 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.618241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:39787 (local address 127.0.0.1:50226)
0807 02:17:20.619110 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.619124 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.619438 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.619826 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.619829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.619847 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.619938 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.619943 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.621142 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.621148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.622332 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.622343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.623110 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.623121 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.623212 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.623241 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.623333 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.623400 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":3,"thread_start_us":66,"threads_started":1}
I20260807 02:17:20.624027 11124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4665503e89fc4676888ff2a847089d82" is_pre_election: true
I20260807 02:17:20.624220 11124 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a3dbbaeb54445bbfd6fe9d38add934 in term 1.
I20260807 02:17:20.624598 11354 leader_election.cc:302] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4665503e89fc4676888ff2a847089d82, 56a3dbbaeb54445bbfd6fe9d38add934; no voters: df7644d4c53b4cd59c52871a51a27edb
I20260807 02:17:20.624744 12160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.620401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:45001 (local address 127.0.0.1:60194)
0807 02:17:20.620495 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.620508 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.620593 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.621278 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.621281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.621314 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.621403 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.621411 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.622390 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.622395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.623294 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.623303 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.624330 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.624334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.624426 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.624458 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.624545 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.624612 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":36,"thread_start_us":61,"threads_started":1}
I20260807 02:17:20.624771 12162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.620756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60194 (local address 127.1.126.252:45001)
0807 02:17:20.621012 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.621023 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.621038 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:20.621080 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.621082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.621131 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.621544 (+ 413us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.621650 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.622278 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.623418 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.624215 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.624330 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.624383 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.624575 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.624661 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
I20260807 02:17:20.624953 12153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 02:17:20.625003 12153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df7644d4c53b4cd59c52871a51a27edb)
I20260807 02:17:20.625041 12153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 1 FOLLOWER]: Advancing to term 2
I20260807 02:17:20.625362 11394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4665503e89fc4676888ff2a847089d82" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" is_pre_election: true
I20260807 02:17:20.626392 12153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } }
I20260807 02:17:20.626649 11394 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4665503e89fc4676888ff2a847089d82 in current term 2: Already voted for candidate 56a3dbbaeb54445bbfd6fe9d38add934 in this term.
I20260807 02:17:20.626816 12153 leader_election.cc:288] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [CANDIDATE]: Term 2 election: Requested vote from peers df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555), 4665503e89fc4676888ff2a847089d82 (127.1.126.253:39787)
I20260807 02:17:20.627154 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.626940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49216)
0807 02:17:20.627033 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.627096 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 02:17:20.627307 11124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4665503e89fc4676888ff2a847089d82"
I20260807 02:17:20.627413 11124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 1 FOLLOWER]: Advancing to term 2
I20260807 02:17:20.627543 11089 leader_election.cc:302] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4665503e89fc4676888ff2a847089d82; no voters: 56a3dbbaeb54445bbfd6fe9d38add934, df7644d4c53b4cd59c52871a51a27edb
I20260807 02:17:20.627894 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.627600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49228)
0807 02:17:20.627792 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.627840 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260807 02:17:20.627985 11354 leader_election.cc:334] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555): Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
I20260807 02:17:20.628525 11124 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a3dbbaeb54445bbfd6fe9d38add934 in term 2.
I20260807 02:17:20.628633 12158 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:17:20.628863 11354 leader_election.cc:302] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4665503e89fc4676888ff2a847089d82, 56a3dbbaeb54445bbfd6fe9d38add934; no voters: df7644d4c53b4cd59c52871a51a27edb
I20260807 02:17:20.629056 12153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 02:17:20.629237 12153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [term 2 LEADER]: Becoming Leader. State: Replica: 56a3dbbaeb54445bbfd6fe9d38add934, State: Running, Role: LEADER
I20260807 02:17:20.629498 12153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } }
I20260807 02:17:20.630686 12165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56a3dbbaeb54445bbfd6fe9d38add934. Latest consensus state: current_term: 2 leader_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:20.630836 12165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:20.631114 12169 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:20.633379 12169 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:20.633782 12169 catalog_manager.cc:1259] Loaded cluster ID: 6045c4315b5f4b038972cf3b3dab7d09
I20260807 02:17:20.633850 12169 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:20.634373 12169 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:20.634877 12169 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Loaded TSK: 0
I20260807 02:17:20.635509 12169 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:20.673120 11375 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:20.676347 11375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:20.679073 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.678833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49254)
0807 02:17:20.678942 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.678999 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 02:17:20.679335 11124 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [term 2 FOLLOWER]: Refusing update from remote peer 56a3dbbaeb54445bbfd6fe9d38add934: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 02:17:20.679850 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.679518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.0.0.1:49264)
0807 02:17:20.679729 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.679779 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260807 02:17:20.679837 12153 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 02:17:20.680020 11354 consensus_peers.cc:487] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 -> Peer df7644d4c53b4cd59c52871a51a27edb (127.1.126.254:36555): Couldn't send request to peer df7644d4c53b4cd59c52871a51a27edb. Status: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 02:17:20.681334 12158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56a3dbbaeb54445bbfd6fe9d38add934. Latest consensus state: current_term: 2 leader_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:20.681458 12158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:20.682736 12153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:20.682843 12153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:20.683218 12158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "df7644d4c53b4cd59c52871a51a27edb" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36555 } } peers { permanent_uuid: "4665503e89fc4676888ff2a847089d82" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 39787 } attrs { promote: false } } peers { permanent_uuid: "56a3dbbaeb54445bbfd6fe9d38add934" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 45001 } attrs { promote: false } } }
I20260807 02:17:20.683310 12171 mvcc.cc:205] Tried to move back new op lower bound from 7315738790617321472 to 7315738790420885504. Current Snapshot: MvccSnapshot[applied={T|T < 7315738790617321472}]
I20260807 02:17:20.683342 12158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4665503e89fc4676888ff2a847089d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:17:20.692843 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.688445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35993 (local address 127.0.0.1:57368)
0807 02:17:20.688536 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.688564 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.688642 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.689290 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.689292 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.689309 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.689423 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.689428 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.690514 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.690517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.691635 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.691645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.692508 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.692512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.692609 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.692636 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.692697 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.692752 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":38}
I20260807 02:17:20.693359 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.688589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57368 (local address 127.1.126.193:35993)
0807 02:17:20.688994 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.688999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.689013 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:20.689091 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.689093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.689154 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.689510 (+ 356us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.689643 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.690389 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.691760 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.692368 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.693051 (+ 683us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.693122 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.693156 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.693215 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":62,"threads_started":1}
I20260807 02:17:20.693724 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.688931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39393 (local address 127.0.0.1:48746)
0807 02:17:20.689183 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.689199 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.689284 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.690114 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.690116 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.690130 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.690193 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.690202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.691312 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.691316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.692470 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.692480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.693323 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.693327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.693422 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.693452 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.693529 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.693600 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260807 02:17:20.693763 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.689239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.1.126.194:39393)
0807 02:17:20.689768 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.689773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.689786 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:20.689881 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.689884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.689933 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.690300 (+ 367us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.690399 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.691199 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.692593 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.693202 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.693310 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.693370 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.693559 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.693634 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":73,"threads_started":1}
I20260807 02:17:20.693909 12155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.688669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:33303 (local address 127.0.0.1:36100)
0807 02:17:20.689043 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.689057 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.689137 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.690025 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.690030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.690051 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.690153 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.690159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.691072 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.691077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.692347 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.692359 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.693559 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.693563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.693648 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.693673 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.693729 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.693794 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":45}
I20260807 02:17:20.693912 11560 tablet_service.cc:1467] Processing CreateTablet for tablet f81512f770e44711868b2abf78308ba3 (DEFAULT_TABLE table=test-table [id=d27d2c18d1054eccb4e4bd9e672ce6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:20.694216 11560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81512f770e44711868b2abf78308ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:20.694258 11752 tablet_service.cc:1467] Processing CreateTablet for tablet f81512f770e44711868b2abf78308ba3 (DEFAULT_TABLE table=test-table [id=d27d2c18d1054eccb4e4bd9e672ce6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:20.694401 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.689470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.1.126.195:33303)
0807 02:17:20.689737 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.689741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.689755 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:20.689845 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.689848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.689912 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.690011 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.690277 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.690960 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.692495 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.693411 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.694091 (+ 680us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.694176 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.694214 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.694283 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
I20260807 02:17:20.694497 11752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81512f770e44711868b2abf78308ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:20.695009 11947 tablet_service.cc:1467] Processing CreateTablet for tablet f81512f770e44711868b2abf78308ba3 (DEFAULT_TABLE table=test-table [id=d27d2c18d1054eccb4e4bd9e672ce6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:20.695252 11947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81512f770e44711868b2abf78308ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:20.696732 12181 tablet_bootstrap.cc:492] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Bootstrap starting.
I20260807 02:17:20.697738 12186 tablet_bootstrap.cc:492] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Bootstrap starting.
I20260807 02:17:20.697773 12181 tablet_bootstrap.cc:654] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:20.697868 12182 tablet_bootstrap.cc:492] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6: Bootstrap starting.
I20260807 02:17:20.698625 12186 tablet_bootstrap.cc:654] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:20.698887 12182 tablet_bootstrap.cc:654] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:20.699015 12181 tablet_bootstrap.cc:492] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: No bootstrap required, opened a new log
I20260807 02:17:20.699112 12181 ts_tablet_manager.cc:1397] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:20.699477 12181 raft_consensus.cc:348] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.699586 12181 raft_consensus.cc:374] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:20.699625 12181 raft_consensus.cc:729] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d600874dc31c42e5bd499e68fd5b192a, State: Initialized, Role: FOLLOWER
I20260807 02:17:20.699760 12181 consensus_queue.cc:260] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.700078 12182 tablet_bootstrap.cc:492] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6: No bootstrap required, opened a new log
I20260807 02:17:20.700111 12181 ts_tablet_manager.cc:1428] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:20.700153 12182 ts_tablet_manager.cc:1397] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:20.700667 12182 raft_consensus.cc:348] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.700780 12182 raft_consensus.cc:374] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:20.700822 12182 raft_consensus.cc:729] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f41e03dee44b4b6696b2a66a7ce096b6, State: Initialized, Role: FOLLOWER
I20260807 02:17:20.700942 12182 consensus_queue.cc:260] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.701278 12182 ts_tablet_manager.cc:1428] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 02:17:20.702128 12186 tablet_bootstrap.cc:492] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: No bootstrap required, opened a new log
I20260807 02:17:20.702210 12186 ts_tablet_manager.cc:1397] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260807 02:17:20.702620 12186 raft_consensus.cc:348] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.702778 12186 raft_consensus.cc:374] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:20.702812 12186 raft_consensus.cc:729] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49c8bc1e5134088adc9c26143a6d8a8, State: Initialized, Role: FOLLOWER
I20260807 02:17:20.702948 12186 consensus_queue.cc:260] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.703135 11848 heartbeater.cc:503] Master 127.1.126.252:45001 was elected leader, sending a full tablet report...
I20260807 02:17:20.703284 12186 ts_tablet_manager.cc:1428] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:20.704103 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.702827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.193:58453)
0807 02:17:20.703962 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.704019 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1069,"thread_start_us":133,"threads_started":1}
I20260807 02:17:20.704594 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.703965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:49253)
0807 02:17:20.704440 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.704493 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":91,"threads_started":1}
I20260807 02:17:20.705214 12192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.700543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:37651)
0807 02:17:20.704939 (+ 4396us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.704998 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4331,"thread_start_us":120,"threads_started":1}
I20260807 02:17:20.705677 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.705298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:35385)
0807 02:17:20.705552 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.705599 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173}
I20260807 02:17:20.705756 12043 heartbeater.cc:503] Master 127.1.126.252:45001 was elected leader, sending a full tablet report...
I20260807 02:17:20.705986 12192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.705604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:51433)
0807 02:17:20.705870 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.705919 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":92,"threads_started":1}
I20260807 02:17:20.752300 12195 raft_consensus.cc:482] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:20.752434 12195 raft_consensus.cc:504] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.753464 12195 leader_election.cc:288] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993), d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393)
I20260807 02:17:20.757181 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.753826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:51233 (local address 127.1.126.194:39393)
0807 02:17:20.753984 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.753988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.754149 (+ 161us) server_negotiation.cc:407] Connection header received
0807 02:17:20.754303 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.754305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.754344 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.754419 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.754676 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.755198 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.756163 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.756579 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.756706 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.756767 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.756989 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.757065 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 02:17:20.757184 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.753723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:43319 (local address 127.1.126.193:35993)
0807 02:17:20.753847 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.753852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.753968 (+ 116us) server_negotiation.cc:407] Connection header received
0807 02:17:20.754180 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.754183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.754224 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.754304 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:20.754552 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.755104 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.756150 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.756550 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.756698 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.756761 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.756978 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.757064 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:17:20.757193 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.753690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:39393 (local address 127.1.126.195:51233)
0807 02:17:20.754051 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.754062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.754186 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.754442 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.754444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.754461 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.754566 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.754571 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.755309 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.755313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.756039 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.756047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.756707 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.756710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.756867 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.756884 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.756970 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.757040 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":43,"thread_start_us":117,"threads_started":1}
I20260807 02:17:20.757195 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.753637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35993 (local address 127.1.126.195:43319)
0807 02:17:20.753849 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.753881 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:20.754044 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:20.754315 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:20.754318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:20.754335 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:20.754440 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.754445 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.755214 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.755218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.756015 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:20.756024 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.756699 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.756703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:20.756832 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.756869 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 02:17:20.756960 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 02:17:20.757030 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":25}
I20260807 02:17:20.757870 11778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81512f770e44711868b2abf78308ba3" candidate_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d600874dc31c42e5bd499e68fd5b192a" is_pre_election: true
I20260807 02:17:20.758111 11778 raft_consensus.cc:2454] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49c8bc1e5134088adc9c26143a6d8a8 in term 0.
I20260807 02:17:20.758404 11591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81512f770e44711868b2abf78308ba3" candidate_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" is_pre_election: true
I20260807 02:17:20.758555 11591 raft_consensus.cc:2454] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49c8bc1e5134088adc9c26143a6d8a8 in term 0.
I20260807 02:17:20.758527 11890 leader_election.cc:302] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c49c8bc1e5134088adc9c26143a6d8a8, d600874dc31c42e5bd499e68fd5b192a; no voters:
I20260807 02:17:20.758869 12195 raft_consensus.cc:2781] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:20.758939 12195 raft_consensus.cc:482] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:20.758992 12195 raft_consensus.cc:3037] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:20.760005 12195 raft_consensus.cc:504] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.760365 12195 leader_election.cc:288] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [CANDIDATE]: Term 1 election: Requested vote from peers f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993), d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393)
I20260807 02:17:20.760741 11778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81512f770e44711868b2abf78308ba3" candidate_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d600874dc31c42e5bd499e68fd5b192a"
I20260807 02:17:20.760762 11591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81512f770e44711868b2abf78308ba3" candidate_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f41e03dee44b4b6696b2a66a7ce096b6"
I20260807 02:17:20.760862 11591 raft_consensus.cc:3037] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:20.760862 11778 raft_consensus.cc:3037] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:20.761977 11591 raft_consensus.cc:2454] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49c8bc1e5134088adc9c26143a6d8a8 in term 1.
I20260807 02:17:20.761977 11778 raft_consensus.cc:2454] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49c8bc1e5134088adc9c26143a6d8a8 in term 1.
I20260807 02:17:20.762301 11890 leader_election.cc:302] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c49c8bc1e5134088adc9c26143a6d8a8, d600874dc31c42e5bd499e68fd5b192a; no voters:
I20260807 02:17:20.762530 12195 raft_consensus.cc:2781] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:20.762775 12195 raft_consensus.cc:686] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 LEADER]: Becoming Leader. State: Replica: c49c8bc1e5134088adc9c26143a6d8a8, State: Running, Role: LEADER
I20260807 02:17:20.763042 12195 consensus_queue.cc:237] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } }
I20260807 02:17:20.763617 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.763389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:42467)
0807 02:17:20.763492 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.763543 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 02:17:20.765599 11376 catalog_manager.cc:5495] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195). New cstate: current_term: 1 leader_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49c8bc1e5134088adc9c26143a6d8a8" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 33303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 } health_report { overall_health: UNKNOWN } } }
I20260807 02:17:20.793550 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.790284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36104 (local address 127.1.126.195:33303)
0807 02:17:20.790399 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:20.790404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:20.790424 (+ 20us) server_negotiation.cc:407] Connection header received
0807 02:17:20.790546 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:20.790548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:20.790598 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:20.790686 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:20.790963 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.791470 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.792312 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:20.792509 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:20.792583 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:20.792800 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:20.793206 (+ 406us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:20.793289 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:20.793410 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 02:17:20.793453 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 02:17:20.796366 11591 raft_consensus.cc:1261] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Refusing update from remote peer c49c8bc1e5134088adc9c26143a6d8a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:20.796624 11778 raft_consensus.cc:1261] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Refusing update from remote peer c49c8bc1e5134088adc9c26143a6d8a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:20.796911 12195 consensus_queue.cc:1035] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f41e03dee44b4b6696b2a66a7ce096b6" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:20.797189 12205 consensus_queue.cc:1035] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d600874dc31c42e5bd499e68fd5b192a" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 39393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:20.798211 11655 heartbeater.cc:503] Master 127.1.126.252:45001 was elected leader, sending a full tablet report...
I20260807 02:17:20.800138 12192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.799898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:45313)
0807 02:17:20.799997 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.800063 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 02:17:20.801426 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.801152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:42667)
0807 02:17:20.801292 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.801353 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 02:17:20.801579 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.800414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.193:51681)
0807 02:17:20.801430 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.801488 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":944}
I20260807 02:17:20.802588 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.802375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.193:49115)
0807 02:17:20.802466 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.802525 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 02:17:20.804376 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.804118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.195:35679)
0807 02:17:20.804265 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.804313 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 02:17:20.805177 12192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.804923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36555 (local address 127.1.126.194:57241)
0807 02:17:20.805063 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.805112 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 02:17:20.806062 12215 mvcc.cc:205] Tried to move back new op lower bound from 7315738791096610816 to 7315738790968205312. Current Snapshot: MvccSnapshot[applied={T|T < 7315738791096610816 or (T in {7315738791096610816})}]
I20260807 02:17:20.813848 11375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:20.813982 11375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:20.817972 11375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56a3dbbaeb54445bbfd6fe9d38add934: Sending DeleteTablet for 3 replicas of tablet f81512f770e44711868b2abf78308ba3
I20260807 02:17:20.818656 11560 tablet_service.cc:1514] Processing DeleteTablet for tablet f81512f770e44711868b2abf78308ba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:20 UTC) from {username='oryx', principal='oryx/127.1.126.252@KRBTEST.COM'} at 127.0.0.1:57368
I20260807 02:17:20.819098 12224 tablet_replica.cc:330] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6: stopping tablet replica
I20260807 02:17:20.819233 12224 raft_consensus.cc:2229] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:20.819365 12224 raft_consensus.cc:2258] T f81512f770e44711868b2abf78308ba3 P f41e03dee44b4b6696b2a66a7ce096b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:20.819636 11947 tablet_service.cc:1514] Processing DeleteTablet for tablet f81512f770e44711868b2abf78308ba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:20 UTC) from {username='oryx', principal='oryx/127.1.126.252@KRBTEST.COM'} at 127.0.0.1:36100
I20260807 02:17:20.819877 11752 tablet_service.cc:1514] Processing DeleteTablet for tablet f81512f770e44711868b2abf78308ba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:20 UTC) from {username='oryx', principal='oryx/127.1.126.252@KRBTEST.COM'} at 127.0.0.1:48746
I20260807 02:17:20.819962 12225 tablet_replica.cc:330] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: stopping tablet replica
I20260807 02:17:20.820086 12225 raft_consensus.cc:2229] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:20.820384 12225 raft_consensus.cc:2258] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:20.820483 12228 tablet_replica.cc:330] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: stopping tablet replica
I20260807 02:17:20.820604 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 11323
I20260807 02:17:20.820602 12228 raft_consensus.cc:2229] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:20.822883 12228 raft_consensus.cc:2258] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:20.825980 12228 ts_tablet_manager.cc:1905] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:20.830262 12228 ts_tablet_manager.cc:1918] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:20.830350 12228 log.cc:1196] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/f81512f770e44711868b2abf78308ba3
I20260807 02:17:20.830664 12228 ts_tablet_manager.cc:1939] T f81512f770e44711868b2abf78308ba3 P d600874dc31c42e5bd499e68fd5b192a: Deleting consensus metadata
I20260807 02:17:20.832219 12225 ts_tablet_manager.cc:1905] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:20.832788 11356 catalog_manager.cc:4841] TS d600874dc31c42e5bd499e68fd5b192a (127.1.126.194:39393): tablet f81512f770e44711868b2abf78308ba3 (table test-table [id=d27d2c18d1054eccb4e4bd9e672ce6f6]) successfully deleted
I20260807 02:17:20.834928 12225 ts_tablet_manager.cc:1918] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:20.835012 12225 log.cc:1196] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/f81512f770e44711868b2abf78308ba3
I20260807 02:17:20.835299 12225 ts_tablet_manager.cc:1939] T f81512f770e44711868b2abf78308ba3 P c49c8bc1e5134088adc9c26143a6d8a8: Deleting consensus metadata
I20260807 02:17:20.836040 11355 catalog_manager.cc:4841] TS c49c8bc1e5134088adc9c26143a6d8a8 (127.1.126.195:33303): tablet f81512f770e44711868b2abf78308ba3 (table test-table [id=d27d2c18d1054eccb4e4bd9e672ce6f6]) successfully deleted
I20260807 02:17:20.841356 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 11663
I20260807 02:17:20.841588 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:20.841267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35993 (local address 127.0.0.1:57382)
0807 02:17:20.841410 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:20.841481 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 02:17:20.844556 11355 catalog_manager.cc:4584] TS f41e03dee44b4b6696b2a66a7ce096b6 (127.1.126.193:35993): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f81512f770e44711868b2abf78308ba3: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35993: connect: Connection refused (error 111)
I20260807 02:17:20.853621 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 11858
I20260807 02:17:20.866376 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 10923
I20260807 02:17:20.875960 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 11066
2026-08-07T02:17:20Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5530 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:20 dist-test-slave-39l8 krb5kdc[12238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:20 dist-test-slave-39l8 krb5kdc[12238](info): set up 2 sockets
Aug 07 02:17:20 dist-test-slave-39l8 krb5kdc[12238](info): commencing operation
krb5kdc: starting...
W20260807 02:17:22.085279 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab.
Entry for principal oryx/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab.
I20260807 02:17:22.208992 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:34175
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab
--principal=oryx/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:41961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:34175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:22.323990 12253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:22.324288 12253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:22.324370 12253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:22.328353 12253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:22.328437 12253 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 02:17:22.328469 12253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:22.328543 12253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:22.328603 12253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:22.328649 12253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:22.334052 12253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:34175
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.254.keytab
--principal=oryx/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:34175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:22.335180 12253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:22.336218 12253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:22.344993 12263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:22.345026 12264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:22.345021 12266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:22.345280 12253 server_base.cc:1034] running on GCE node
I20260807 02:17:22.345930 12253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:22.347071 12253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:22.348260 12253 hybrid_clock.cc:648] HybridClock initialized: now 1786069042348249 us; error 27 us; skew 500 ppm
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:22.350955 12253 init.cc:377] Logged in from keytab as oryx/127.1.126.254@KRBTEST.COM (short username oryx)
I20260807 02:17:22.351758 12253 webserver.cc:460] Webserver started at http://127.1.126.254:45779/ using document root <none> and password file <none>
I20260807 02:17:22.352284 12253 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:22.352345 12253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:22.352509 12253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:22.354418 12253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "3f2a284852a84eb79778939f363b8ae5"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "0320d3e1d764a51ed226c6f3e45eea30"
server_key_iv: "05d3493cd43155121288f9115a54848a"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.355024 12253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "3f2a284852a84eb79778939f363b8ae5"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "0320d3e1d764a51ed226c6f3e45eea30"
server_key_iv: "05d3493cd43155121288f9115a54848a"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.358553 12253 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 02:17:22.360934 12275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:22.362161 12253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:22.362301 12253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "3f2a284852a84eb79778939f363b8ae5"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "0320d3e1d764a51ed226c6f3e45eea30"
server_key_iv: "05d3493cd43155121288f9115a54848a"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.362408 12253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:22.408114 12253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:22.411238 12253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:22.411453 12253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:22.420539 12253 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:34175
I20260807 02:17:22.420572 12367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:34175 every 8 connection(s)
I20260807 02:17:22.421527 12253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:22.424297 12368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:22.426637 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 12253
I20260807 02:17:22.426807 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:22.427151 1531 external_mini_cluster.cc:1428] Setting key 290af9cbfd4e8f34f80cecd9ce74c01a
I20260807 02:17:22.430819 12368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Bootstrap starting.
I20260807 02:17:22.433085 12368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:22.433842 12368 log.cc:824] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:22.435786 12368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: No bootstrap required, opened a new log
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:22.439391 12368 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2a284852a84eb79778939f363b8ae5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34175 } }
I20260807 02:17:22.439644 12368 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:22.439713 12368 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2a284852a84eb79778939f363b8ae5, State: Initialized, Role: FOLLOWER
I20260807 02:17:22.440209 12368 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2a284852a84eb79778939f363b8ae5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34175 } }
I20260807 02:17:22.440390 12368 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:22.440483 12368 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:22.440594 12368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:22.441210 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.428657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38116 (local address 127.1.126.254:34175)
0807 02:17:22.429154 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:22.429185 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:22.429230 (+ 45us) server_negotiation.cc:407] Connection header received
0807 02:17:22.429952 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:22.429971 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:22.430309 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:22.430631 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:22.431528 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.432530 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.433470 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.433936 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.434116 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.436671 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:22.436677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:22.436689 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:22.436714 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:22.438322 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.438794 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.438799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.438803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.438906 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.439221 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.439224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.439225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.439584 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:22.439829 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:22.440077 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 02:17:22.440364 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":137,"threads_started":1}
I20260807 02:17:22.441552 12368 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2a284852a84eb79778939f363b8ae5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34175 } }
I20260807 02:17:22.441927 12368 leader_election.cc:302] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f2a284852a84eb79778939f363b8ae5; no voters:
I20260807 02:17:22.442250 12368 leader_election.cc:288] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:22.442353 12377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:22.442589 12377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2a284852a84eb79778939f363b8ae5, State: Running, Role: LEADER
I20260807 02:17:22.442934 12377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2a284852a84eb79778939f363b8ae5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34175 } }
I20260807 02:17:22.443509 12368 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:22.444550 12378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f2a284852a84eb79778939f363b8ae5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2a284852a84eb79778939f363b8ae5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34175 } } }
I20260807 02:17:22.444682 12378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:22.444999 12380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f2a284852a84eb79778939f363b8ae5. Latest consensus state: current_term: 1 leader_uuid: "3f2a284852a84eb79778939f363b8ae5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2a284852a84eb79778939f363b8ae5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 34175 } } }
I20260807 02:17:22.445088 12380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:22.445195 12390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:22.447903 12390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:22.453769 12390 catalog_manager.cc:1347] Generated new cluster ID: 7794f153766d4ae8bacfbc76430bd175
I20260807 02:17:22.453835 12390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:22.460644 12390 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:22.461781 12390 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:22.469657 12390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Generated new TSK 0
I20260807 02:17:22.470412 12390 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab.
Entry for principal oryx/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab.
I20260807 02:17:22.497402 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34175
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:41961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:22.609776 12405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:22.610015 12405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:22.610057 12405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:22.614007 12405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:22.614059 12405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:22.614096 12405 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:17:22.614127 12405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:22.619079 12405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:22.619992 12405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:22.620922 12405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:22.630355 12413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:22.630327 12416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:22.630373 12414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:22.630841 12405 server_base.cc:1034] running on GCE node
I20260807 02:17:22.631278 12405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:22.631924 12405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:22.633085 12405 hybrid_clock.cc:648] HybridClock initialized: now 1786069042633072 us; error 28 us; skew 500 ppm
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:22.635861 12405 init.cc:377] Logged in from keytab as oryx/127.1.126.193@KRBTEST.COM (short username oryx)
I20260807 02:17:22.636708 12405 webserver.cc:460] Webserver started at http://127.1.126.193:42617/ using document root <none> and password file <none>
I20260807 02:17:22.637219 12405 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:22.637292 12405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:22.637468 12405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:22.639492 12405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "aa0bb88651884ec4aa1c53c0e1390185"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "bee48584ccd571cd5d4ae89a9d96d253"
server_key_iv: "4534d7b31efdb6e68c854415874bc966"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.640010 12405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "aa0bb88651884ec4aa1c53c0e1390185"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "bee48584ccd571cd5d4ae89a9d96d253"
server_key_iv: "4534d7b31efdb6e68c854415874bc966"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.643783 12405 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:17:22.646517 12426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:22.647861 12405 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:17:22.647987 12405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "aa0bb88651884ec4aa1c53c0e1390185"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "bee48584ccd571cd5d4ae89a9d96d253"
server_key_iv: "4534d7b31efdb6e68c854415874bc966"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.648097 12405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:22.661012 12405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:22.664425 12405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:22.664630 12405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:22.666257 12405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:22.666308 12405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:22.666352 12405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:22.666409 12405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:22.677794 12405 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:37835
I20260807 02:17:22.677821 12597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:37835 every 8 connection(s)
I20260807 02:17:22.678750 12405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:22.680364 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.667009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:58307 (local address 127.1.126.254:34175)
0807 02:17:22.667184 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:22.667190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:22.668060 (+ 870us) server_negotiation.cc:407] Connection header received
0807 02:17:22.669025 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:22.669029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:22.669098 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:22.669206 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:22.670566 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.671542 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.672773 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.673196 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.673333 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.676495 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:22.676498 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:22.676502 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:22.676539 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:22.678212 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.678794 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.678801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.678804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.678897 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.679298 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.679302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.679303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.679529 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:22.679642 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:22.680129 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 02:17:22.680241 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 02:17:22.681185 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.667410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.1.126.193:58307)
0807 02:17:22.667866 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:22.667915 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:22.668770 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:22.669493 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:22.669503 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:22.669920 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:22.670399 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.670412 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.671697 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.671701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.672636 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.672646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.673411 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.673418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.673648 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.674375 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:22.674403 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:22.676309 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:22.678337 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.678343 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.678358 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.678630 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.679000 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.679003 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.679005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.679155 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.679651 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:22.679658 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:22.679899 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 02:17:22.680065 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 02:17:22.680321 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":131,"threads_started":1}
I20260807 02:17:22.682751 12599 heartbeater.cc:347] Connected to a master server at 127.1.126.254:34175
I20260807 02:17:22.682925 12599 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:22.683455 12599 heartbeater.cc:511] Master 127.1.126.254:34175 requested a full tablet report, sending...
I20260807 02:17:22.683753 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 12405
I20260807 02:17:22.683890 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:22.684247 1531 external_mini_cluster.cc:1428] Setting key 94ceafaee6ff5be77760c2b0b7bcf879
I20260807 02:17:22.685405 12300 ts_manager.cc:194] Registered new tserver with Master: aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835)
I20260807 02:17:22.686916 12300 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:58307
I20260807 02:17:22.693722 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.685250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:43327 (local address 127.1.126.254:34175)
0807 02:17:22.685363 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:22.685367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:22.685593 (+ 226us) server_negotiation.cc:407] Connection header received
0807 02:17:22.685809 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:22.685812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:22.685867 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:22.685960 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:22.686506 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.687360 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.688402 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.688724 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.688839 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.689961 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:22.689966 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:22.689971 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:22.690004 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:22.691600 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.692203 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.692206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.692208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.692290 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.692671 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.692674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.692676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.692876 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:22.692981 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:22.693441 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 02:17:22.693601 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:17:22.694088 12609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.685141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.1.126.193:43327)
0807 02:17:22.685481 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:22.685497 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:22.685597 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:22.686002 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:22.686005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:22.686239 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:22.686362 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.686370 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.687517 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.687521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.688245 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.688256 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.688850 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.688853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.688920 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.689459 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:22.689470 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:22.689809 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:22.691740 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.691747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.691752 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.692066 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.692402 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.692408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.692412 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.692526 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.693007 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:22.693013 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:22.693173 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 02:17:22.693310 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 02:17:22.693493 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for oryx/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab.
Entry for principal oryx/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab.
I20260807 02:17:22.717756 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34175
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:41961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:22.836757 12612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:22.837059 12612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:22.837105 12612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:22.841158 12612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:22.841225 12612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:22.841264 12612 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:17:22.841297 12612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:22.847208 12612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:22.848343 12612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:22.849371 12612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:22.859417 12623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:22.859637 12612 server_base.cc:1034] running on GCE node
W20260807 02:17:22.859426 12621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:22.859426 12620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:22.860211 12612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:22.860935 12612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:22.862125 12612 hybrid_clock.cc:648] HybridClock initialized: now 1786069042862106 us; error 35 us; skew 500 ppm
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:22.865033 12612 init.cc:377] Logged in from keytab as oryx/127.1.126.194@KRBTEST.COM (short username oryx)
I20260807 02:17:22.866053 12612 webserver.cc:460] Webserver started at http://127.1.126.194:46537/ using document root <none> and password file <none>
I20260807 02:17:22.866668 12612 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:22.866818 12612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:22.867142 12612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:22.869290 12612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "c4eac21bcf5cdf5f803f01e875b7545f"
server_key_iv: "cc77e519f9888fea4346072609bf666d"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.869899 12612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "c4eac21bcf5cdf5f803f01e875b7545f"
server_key_iv: "cc77e519f9888fea4346072609bf666d"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.873992 12612 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:17:22.876763 12638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:22.878171 12612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:17:22.878351 12612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
format_stamp: "Formatted at 2026-08-07 02:17:22 on dist-test-slave-39l8"
server_key: "c4eac21bcf5cdf5f803f01e875b7545f"
server_key_iv: "cc77e519f9888fea4346072609bf666d"
server_key_version: "encryptionkey@0"
I20260807 02:17:22.878485 12612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:22.904210 12612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:22.907431 12612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:22.907691 12612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:22.909375 12612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:22.909453 12612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:22.909518 12612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:22.909555 12612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:17:22 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:22.921413 12612 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42883
I20260807 02:17:22.921469 12795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42883 every 8 connection(s)
I20260807 02:17:22.922534 12612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:22.924503 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.910110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:50359 (local address 127.1.126.254:34175)
0807 02:17:22.910246 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:22.910258 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:22.911367 (+ 1109us) server_negotiation.cc:407] Connection header received
0807 02:17:22.912413 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:22.912417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:22.912481 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:22.912575 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:22.913959 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.914914 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.916514 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.916799 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.916929 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.920243 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:22.920247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:22.920249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:22.920281 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:22.922101 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.922811 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.922815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.922817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.922926 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.923378 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.923382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.923383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.923649 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:22.923742 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:22.924263 (+ 521us) server_negotiation.cc:299] Negotiation successful
0807 02:17:22.924382 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:17:22.925314 12649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.910672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.1.126.194:50359)
0807 02:17:22.911209 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:22.911251 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:22.912191 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:22.912914 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:22.912922 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:22.913272 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:22.913744 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.913757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.915062 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.915068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.916384 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.916397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.916972 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.916976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.917174 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.917847 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:22.917874 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:22.919979 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:22.922237 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.922243 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.922258 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.922643 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.923047 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.923053 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.923057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.923243 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.923775 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:22.923781 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:22.924029 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 02:17:22.924193 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 02:17:22.924452 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":153,"threads_started":1}
I20260807 02:17:22.926199 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 12612
I20260807 02:17:22.926376 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:22.926748 1531 external_mini_cluster.cc:1428] Setting key eec0e831e576f575aa152bc25f9d7e75
I20260807 02:17:22.926968 12797 heartbeater.cc:347] Connected to a master server at 127.1.126.254:34175
I20260807 02:17:22.927166 12797 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:22.927759 12797 heartbeater.cc:511] Master 127.1.126.254:34175 requested a full tablet report, sending...
I20260807 02:17:22.928942 12300 ts_manager.cc:194] Registered new tserver with Master: 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883)
I20260807 02:17:22.930002 12300 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:50359
I20260807 02:17:22.937994 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.929360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:41631 (local address 127.1.126.254:34175)
0807 02:17:22.929487 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:22.929492 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:22.929876 (+ 384us) server_negotiation.cc:407] Connection header received
0807 02:17:22.930052 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:22.930055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:22.930106 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:22.930165 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:22.930821 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.931625 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.932777 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.932990 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.933081 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.934364 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:22.934367 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:22.934369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:22.934392 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:22.936214 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.936689 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.936694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.936696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.936782 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:22.937081 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:22.937084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:22.937086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:22.937309 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:22.937427 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:22.937720 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 02:17:22.937833 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:17:22.938004 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:22.929306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.1.126.194:41631)
0807 02:17:22.929782 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:22.929803 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:22.929919 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:22.930315 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:22.930318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:22.930532 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:22.930688 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.930696 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.931780 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.931784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.932642 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:22.932656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:22.933111 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:22.933115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:22.933236 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:22.933815 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:22.933832 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:22.934201 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:22.936352 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.936357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.936359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.936580 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.936882 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:22.936885 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:22.936887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:22.936978 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:22.937418 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:22.937421 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:22.937526 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 02:17:22.937659 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 02:17:22.937821 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":123,"threads_started":1}
WARNING: no policy specified for oryx/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab.
Entry for principal oryx/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab.
I20260807 02:17:22.958964 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:34175
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:41961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:23.076306 12809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:23.076586 12809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:23.076630 12809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:23.080837 12809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:23.080907 12809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:23.080953 12809 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 02:17:23.080993 12809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:23.086647 12809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.126.254:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:23.087790 12809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:23.088794 12809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:23.098609 12820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:23.098678 12817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:23.098635 12823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:23.098928 12809 server_base.cc:1034] running on GCE node
I20260807 02:17:23.099476 12809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:23.100134 12809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:23.101364 12809 hybrid_clock.cc:648] HybridClock initialized: now 1786069043101348 us; error 29 us; skew 500 ppm
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069043, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:23.104719 12809 init.cc:377] Logged in from keytab as oryx/127.1.126.195@KRBTEST.COM (short username oryx)
I20260807 02:17:23.105839 12809 webserver.cc:460] Webserver started at http://127.1.126.195:42727/ using document root <none> and password file <none>
I20260807 02:17:23.106492 12809 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:23.106592 12809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:23.106875 12809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:23.108963 12809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "c5211dc1375b4cbd8a1f33a12f43479e"
format_stamp: "Formatted at 2026-08-07 02:17:23 on dist-test-slave-39l8"
server_key: "d9b20d06618e7a144c35a6160b9fccb0"
server_key_iv: "61d2043930158d30b6a3f9b5e6504d3c"
server_key_version: "encryptionkey@0"
I20260807 02:17:23.109544 12809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "c5211dc1375b4cbd8a1f33a12f43479e"
format_stamp: "Formatted at 2026-08-07 02:17:23 on dist-test-slave-39l8"
server_key: "d9b20d06618e7a144c35a6160b9fccb0"
server_key_iv: "61d2043930158d30b6a3f9b5e6504d3c"
server_key_version: "encryptionkey@0"
I20260807 02:17:23.113380 12809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:17:23.116029 12831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:23.117393 12809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:23.117550 12809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "c5211dc1375b4cbd8a1f33a12f43479e"
format_stamp: "Formatted at 2026-08-07 02:17:23 on dist-test-slave-39l8"
server_key: "d9b20d06618e7a144c35a6160b9fccb0"
server_key_iv: "61d2043930158d30b6a3f9b5e6504d3c"
server_key_version: "encryptionkey@0"
I20260807 02:17:23.117672 12809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:23.127130 12809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:23.130110 12809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:23.130262 12809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:23.131755 12809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:23.131811 12809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:23.131878 12809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:23.131922 12809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069043, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:23.143203 12809 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:37311
I20260807 02:17:23.144178 13001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:37311 every 8 connection(s)
I20260807 02:17:23.144359 12809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:23.146251 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.132732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:48703 (local address 127.1.126.254:34175)
0807 02:17:23.132873 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.132877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.133899 (+ 1022us) server_negotiation.cc:407] Connection header received
0807 02:17:23.135092 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.135096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.135165 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.135240 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:23.136764 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.137433 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.138577 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.138883 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.139002 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.142040 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:23.142043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:23.142045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:23.142071 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:23.143881 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.144528 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.144532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.144534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.144620 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.145013 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.145017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.145019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.145269 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:23.145396 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.145944 (+ 548us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.146078 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:23.146881 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 12809
I20260807 02:17:23.147030 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:23.147078 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.133282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.1.126.195:48703)
0807 02:17:23.133752 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.133793 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.134830 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.135648 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.135655 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.135973 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:23.136594 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.136615 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.137560 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.137564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.138434 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.138443 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.139060 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.139064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.139269 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.139893 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:23.139919 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:23.141848 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:23.144016 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:23.144022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:23.144038 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:23.144426 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:23.144716 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:23.144720 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:23.144722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:23.144896 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:23.145393 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:23.145399 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:23.145709 (+ 310us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.145898 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.146202 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":123,"threads_started":1}
I20260807 02:17:23.147395 1531 external_mini_cluster.cc:1428] Setting key f398272c4ba4503e661f8c3c21b5e69a
I20260807 02:17:23.148823 13002 heartbeater.cc:347] Connected to a master server at 127.1.126.254:34175
I20260807 02:17:23.149662 13002 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:23.150230 13002 heartbeater.cc:511] Master 127.1.126.254:34175 requested a full tablet report, sending...
I20260807 02:17:23.151293 12299 ts_manager.cc:194] Registered new tserver with Master: c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311)
I20260807 02:17:23.152136 12299 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:48703
I20260807 02:17:23.157879 13014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.150861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.1.126.195:34777)
0807 02:17:23.151136 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.151151 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.151256 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.151512 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.151515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.151716 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:23.151857 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.151865 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.152780 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.152784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.153649 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.153659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.154085 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.154089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.154188 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.154755 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:23.154769 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:23.155102 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:23.156522 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:23.156524 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:23.156526 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:23.156715 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:23.156965 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:23.156967 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:23.156969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:23.157044 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:23.157467 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:23.157469 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:23.157544 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.157627 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.157732 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":104,"threads_started":1}
I20260807 02:17:23.157903 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.150911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:34777 (local address 127.1.126.254:34175)
0807 02:17:23.151036 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.151043 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.151233 (+ 190us) server_negotiation.cc:407] Connection header received
0807 02:17:23.151337 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.151339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.151376 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.151478 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:23.151967 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.152618 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.153768 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.153973 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.154071 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.155230 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:23.155234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:23.155236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:23.155256 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:23.156421 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.156805 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.156808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.156809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.156882 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.157158 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.157162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.157163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.157377 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:23.157466 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.157699 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.157795 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:17:23.161481 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069043, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 02:17:23.188410 12372 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:23.181338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38122 (local address 127.1.126.254:34175)
0807 02:17:23.181479 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.181483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.181495 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:17:23.181541 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.181543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.181607 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.181710 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:23.182593 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.183316 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.184203 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.184425 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.184537 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.188284 (+ 3747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38122: BlockingRecv error: recv got EOF from 127.0.0.1:38122 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069043, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:23.198469 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.190132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38134 (local address 127.1.126.254:34175)
0807 02:17:23.190305 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.190309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.190372 (+ 63us) server_negotiation.cc:407] Connection header received
0807 02:17:23.190472 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.190474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.190514 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.190585 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:23.191237 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.191741 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.192490 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.192694 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.192769 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.195174 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:23.195178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:23.195180 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:23.195203 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:23.196683 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.197104 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.197107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.197108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.197182 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.197533 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.197537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.197538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.197743 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:23.197902 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.198179 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.198296 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 02:17:23.201654 12299 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:23.204843 12299 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:23.220054 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.214973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59660 (local address 127.1.126.193:37835)
0807 02:17:23.215318 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.215326 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.215349 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:17:23.215428 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.215433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.215610 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.215934 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.216184 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.217336 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.218780 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.219313 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.219437 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.219597 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.219807 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.219903 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":78,"threads_started":1}
I20260807 02:17:23.220055 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.213897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:37835 (local address 127.0.0.1:59660)
0807 02:17:23.214453 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.214467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.214551 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.215772 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.215775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.215792 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.216037 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.216051 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.217469 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.217472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.218595 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.218606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.219449 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.219453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.219569 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.219636 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.219773 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.219898 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":73,"spinlock_wait_cycles":6016,"thread_start_us":97,"threads_started":1}
I20260807 02:17:23.220288 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.214832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.1.126.194:42883)
0807 02:17:23.215332 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.215343 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.215361 (+ 18us) server_negotiation.cc:407] Connection header received
0807 02:17:23.215428 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.215433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.215611 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.215759 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.216108 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.216853 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.218537 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.219427 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.219550 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.219712 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.220033 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.220134 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":143,"threads_started":1}
I20260807 02:17:23.220546 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.214480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42883 (local address 127.0.0.1:37560)
0807 02:17:23.215145 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.215158 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.215244 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.215774 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.215780 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.215815 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.215965 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.215973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.216978 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.216983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.218399 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.218409 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.219777 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.219781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.219885 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.219903 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.219997 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.220072 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"mutex_wait_us":222,"spinlock_wait_cycles":2432,"thread_start_us":110,"threads_started":1}
I20260807 02:17:23.220572 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.213787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:37311 (local address 127.0.0.1:39644)
0807 02:17:23.214285 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.214332 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.214468 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.215438 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.215444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.215467 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.215621 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.215628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.217098 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.217101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.218553 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.218565 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.219575 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.219579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.220212 (+ 633us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.220232 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.220310 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.220414 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":600,"thread_start_us":84,"threads_started":1}
I20260807 02:17:23.221490 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.213931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39644 (local address 127.1.126.195:37311)
0807 02:17:23.214843 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.214858 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.214894 (+ 36us) server_negotiation.cc:407] Connection header received
0807 02:17:23.214981 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.214989 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.215229 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.215450 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.215738 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.216960 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.218692 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.219429 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.219625 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.219785 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.221123 (+ 1338us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.221253 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":108,"threads_started":1}
I20260807 02:17:23.223773 12709 tablet_service.cc:1467] Processing CreateTablet for tablet 98a9765d787c4c2283d4eba3c2640b09 (DEFAULT_TABLE table=test-table [id=e8e8d192e9e545d2a11021542ebfe737]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:23.223764 12500 tablet_service.cc:1467] Processing CreateTablet for tablet 98a9765d787c4c2283d4eba3c2640b09 (DEFAULT_TABLE table=test-table [id=e8e8d192e9e545d2a11021542ebfe737]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:23.224946 12500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a9765d787c4c2283d4eba3c2640b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.224946 12709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a9765d787c4c2283d4eba3c2640b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.224591 12904 tablet_service.cc:1467] Processing CreateTablet for tablet 98a9765d787c4c2283d4eba3c2640b09 (DEFAULT_TABLE table=test-table [id=e8e8d192e9e545d2a11021542ebfe737]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:23.225649 12904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a9765d787c4c2283d4eba3c2640b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.233202 13038 tablet_bootstrap.cc:492] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Bootstrap starting.
I20260807 02:17:23.234077 13039 tablet_bootstrap.cc:492] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Bootstrap starting.
I20260807 02:17:23.235080 13041 tablet_bootstrap.cc:492] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Bootstrap starting.
I20260807 02:17:23.235765 13038 tablet_bootstrap.cc:654] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.236294 13039 tablet_bootstrap.cc:654] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.236752 13038 log.cc:824] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:23.237159 13041 tablet_bootstrap.cc:654] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.237155 13039 log.cc:824] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:23.238051 13041 log.cc:824] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:23.239202 13038 tablet_bootstrap.cc:492] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: No bootstrap required, opened a new log
I20260807 02:17:23.239216 13039 tablet_bootstrap.cc:492] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: No bootstrap required, opened a new log
I20260807 02:17:23.239431 13039 ts_tablet_manager.cc:1397] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:17:23.239429 13038 ts_tablet_manager.cc:1397] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:17:23.240048 13041 tablet_bootstrap.cc:492] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: No bootstrap required, opened a new log
I20260807 02:17:23.240252 13041 ts_tablet_manager.cc:1397] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 02:17:23.242532 13039 raft_consensus.cc:348] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.242865 13039 raft_consensus.cc:374] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.242954 13039 raft_consensus.cc:729] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f76afd6c74b57baf4c3edaf809e41, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.243479 13039 consensus_queue.cc:260] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.244288 13038 raft_consensus.cc:348] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.244642 13038 raft_consensus.cc:374] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.244650 12797 heartbeater.cc:503] Master 127.1.126.254:34175 was elected leader, sending a full tablet report...
I20260807 02:17:23.244529 13041 raft_consensus.cc:348] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.244733 13038 raft_consensus.cc:729] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.244647 13039 ts_tablet_manager.cc:1428] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:17:23.244776 13041 raft_consensus.cc:374] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.244825 13041 raft_consensus.cc:729] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.245249 13038 consensus_queue.cc:260] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.245249 13041 consensus_queue.cc:260] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.246181 12599 heartbeater.cc:503] Master 127.1.126.254:34175 was elected leader, sending a full tablet report...
I20260807 02:17:23.246284 13041 ts_tablet_manager.cc:1428] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:17:23.246284 13038 ts_tablet_manager.cc:1428] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 02:17:23.246605 13002 heartbeater.cc:503] Master 127.1.126.254:34175 was elected leader, sending a full tablet report...
W20260807 02:17:23.395673 13004 tablet.cc:2369] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:17:23.424003 12798 tablet.cc:2369] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:17:23.430191 12600 tablet.cc:2369] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:17:23.497911 13045 raft_consensus.cc:482] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:23.498203 13045 raft_consensus.cc:504] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.499446 13045 leader_election.cc:288] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311), aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835)
I20260807 02:17:23.503441 13053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.499685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:37311 (local address 127.1.126.194:58881)
0807 02:17:23.500017 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.500032 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.500211 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.500494 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.500498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.500515 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.500656 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.500662 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.501439 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.501443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.502271 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.502281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.502983 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.502987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.503096 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.503132 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.503204 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.503255 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":56,"spinlock_wait_cycles":32128,"thread_start_us":82,"threads_started":1}
I20260807 02:17:23.503443 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.499834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58881 (local address 127.1.126.195:37311)
0807 02:17:23.499970 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.499975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.500143 (+ 168us) server_negotiation.cc:407] Connection header received
0807 02:17:23.500354 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.500358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.500399 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.500455 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.500766 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.501291 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.502415 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.502864 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.502956 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.503035 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.503241 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.503323 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:17:23.503537 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.499869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:55799 (local address 127.1.126.193:37835)
0807 02:17:23.500001 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.500005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.500215 (+ 210us) server_negotiation.cc:407] Connection header received
0807 02:17:23.500361 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.500364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.500405 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.500495 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.500812 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.501287 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.502375 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.502902 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.503042 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.503098 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.503331 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.503400 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:17:23.503496 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.499728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:37835 (local address 127.1.126.194:55799)
0807 02:17:23.500086 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.500098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.500230 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.500529 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.500532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.500576 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.500674 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.500679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.501404 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.501411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.502241 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.502251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.503053 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.503057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.503172 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.503219 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.503298 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.503359 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":22,"spinlock_wait_cycles":4864,"thread_start_us":75,"threads_started":1}
I20260807 02:17:23.504300 12533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a9765d787c4c2283d4eba3c2640b09" candidate_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0bb88651884ec4aa1c53c0e1390185" is_pre_election: true
I20260807 02:17:23.504300 12930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a9765d787c4c2283d4eba3c2640b09" candidate_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" is_pre_election: true
I20260807 02:17:23.504597 12930 raft_consensus.cc:2454] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f76afd6c74b57baf4c3edaf809e41 in term 0.
I20260807 02:17:23.504597 12533 raft_consensus.cc:2454] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2f76afd6c74b57baf4c3edaf809e41 in term 0.
I20260807 02:17:23.505052 12643 leader_election.cc:302] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f76afd6c74b57baf4c3edaf809e41, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:23.505460 13045 raft_consensus.cc:2781] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:23.505564 13045 raft_consensus.cc:482] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:23.505630 13045 raft_consensus.cc:3037] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:23.506786 13045 raft_consensus.cc:504] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.507121 13045 leader_election.cc:288] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [CANDIDATE]: Term 1 election: Requested vote from peers c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311), aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835)
I20260807 02:17:23.507512 12533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a9765d787c4c2283d4eba3c2640b09" candidate_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0bb88651884ec4aa1c53c0e1390185"
I20260807 02:17:23.507507 12930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a9765d787c4c2283d4eba3c2640b09" candidate_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5211dc1375b4cbd8a1f33a12f43479e"
I20260807 02:17:23.507655 12533 raft_consensus.cc:3037] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:23.507669 12930 raft_consensus.cc:3037] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:23.508708 12533 raft_consensus.cc:2454] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f76afd6c74b57baf4c3edaf809e41 in term 1.
I20260807 02:17:23.509023 12642 leader_election.cc:302] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f76afd6c74b57baf4c3edaf809e41, aa0bb88651884ec4aa1c53c0e1390185; no voters:
I20260807 02:17:23.509171 12930 raft_consensus.cc:2454] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2f76afd6c74b57baf4c3edaf809e41 in term 1.
I20260807 02:17:23.509205 13045 raft_consensus.cc:2781] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:23.509362 13045 raft_consensus.cc:686] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 LEADER]: Becoming Leader. State: Replica: 4b2f76afd6c74b57baf4c3edaf809e41, State: Running, Role: LEADER
I20260807 02:17:23.509692 13045 consensus_queue.cc:237] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } }
I20260807 02:17:23.514276 12300 catalog_manager.cc:5495] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194). New cstate: current_term: 1 leader_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } health_report { overall_health: HEALTHY } } }
I20260807 02:17:23.584595 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.581009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37570 (local address 127.1.126.194:42883)
0807 02:17:23.581136 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.581139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.581154 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:23.581264 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.581267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.581322 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.581411 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:23.581640 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.582157 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.583151 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.583470 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.583554 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.583799 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:23.584262 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:23.584348 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.584438 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.584486 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:17:23.590541 12930 raft_consensus.cc:1261] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Refusing update from remote peer 4b2f76afd6c74b57baf4c3edaf809e41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:23.590543 12533 raft_consensus.cc:1261] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Refusing update from remote peer 4b2f76afd6c74b57baf4c3edaf809e41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:23.591260 13045 consensus_queue.cc:1035] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:23.591483 13054 consensus_queue.cc:1035] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:23.606741 12299 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:23.606917 12299 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:23.609349 12299 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Sending DeleteTablet for 3 replicas of tablet 98a9765d787c4c2283d4eba3c2640b09
I20260807 02:17:23.610092 12904 tablet_service.cc:1514] Processing DeleteTablet for tablet 98a9765d787c4c2283d4eba3c2640b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:23 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:39644
I20260807 02:17:23.610224 12709 tablet_service.cc:1514] Processing DeleteTablet for tablet 98a9765d787c4c2283d4eba3c2640b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:23 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37560
I20260807 02:17:23.610671 13076 tablet_replica.cc:330] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: stopping tablet replica
I20260807 02:17:23.610857 13075 tablet_replica.cc:330] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: stopping tablet replica
I20260807 02:17:23.610850 12500 tablet_service.cc:1514] Processing DeleteTablet for tablet 98a9765d787c4c2283d4eba3c2640b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:23 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:59660
I20260807 02:17:23.611022 13076 raft_consensus.cc:2229] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:23.611151 13075 raft_consensus.cc:2229] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:23.611354 13076 raft_consensus.cc:2258] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:23.611474 13075 raft_consensus.cc:2258] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:23.611444 12299 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:23.611841 12299 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:23.612797 13076 ts_tablet_manager.cc:1905] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:23.612890 13075 ts_tablet_manager.cc:1905] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:23.615638 13075 ts_tablet_manager.cc:1918] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:23.615792 13076 ts_tablet_manager.cc:1918] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:23.615820 13075 log.cc:1196] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/98a9765d787c4c2283d4eba3c2640b09
I20260807 02:17:23.615943 13076 log.cc:1196] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/98a9765d787c4c2283d4eba3c2640b09
I20260807 02:17:23.616232 13075 ts_tablet_manager.cc:1939] T 98a9765d787c4c2283d4eba3c2640b09 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting consensus metadata
I20260807 02:17:23.616317 13076 ts_tablet_manager.cc:1939] T 98a9765d787c4c2283d4eba3c2640b09 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting consensus metadata
I20260807 02:17:23.617547 12280 catalog_manager.cc:4841] TS 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883): tablet 98a9765d787c4c2283d4eba3c2640b09 (table test-table [id=e8e8d192e9e545d2a11021542ebfe737]) successfully deleted
I20260807 02:17:23.617622 12709 tablet_service.cc:1467] Processing CreateTablet for tablet 79ef36dab771448290c465b03fe895f8 (DEFAULT_TABLE table=test-table [id=815afc02f01240e4ad98bbaad17551fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:23.617871 12709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79ef36dab771448290c465b03fe895f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.617933 12904 tablet_service.cc:1467] Processing CreateTablet for tablet 79ef36dab771448290c465b03fe895f8 (DEFAULT_TABLE table=test-table [id=815afc02f01240e4ad98bbaad17551fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:23.618194 12904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79ef36dab771448290c465b03fe895f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.618837 12281 catalog_manager.cc:4841] TS c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311): tablet 98a9765d787c4c2283d4eba3c2640b09 (table test-table [id=e8e8d192e9e545d2a11021542ebfe737]) successfully deleted
I20260807 02:17:23.619244 12500 tablet_service.cc:1467] Processing CreateTablet for tablet 79ef36dab771448290c465b03fe895f8 (DEFAULT_TABLE table=test-table [id=815afc02f01240e4ad98bbaad17551fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:23.619520 12500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79ef36dab771448290c465b03fe895f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.620028 13039 tablet_bootstrap.cc:492] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Bootstrap starting.
I20260807 02:17:23.620370 13041 tablet_bootstrap.cc:492] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Bootstrap starting.
I20260807 02:17:23.620968 13039 tablet_bootstrap.cc:654] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.621332 13041 tablet_bootstrap.cc:654] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.622160 13038 tablet_bootstrap.cc:492] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Bootstrap starting.
I20260807 02:17:23.622412 13039 tablet_bootstrap.cc:492] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: No bootstrap required, opened a new log
I20260807 02:17:23.622423 13077 tablet_replica.cc:330] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: stopping tablet replica
I20260807 02:17:23.622481 13039 ts_tablet_manager.cc:1397] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:23.622786 13077 raft_consensus.cc:2229] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:23.622953 13039 raft_consensus.cc:348] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.623054 13039 raft_consensus.cc:374] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.623085 13039 raft_consensus.cc:729] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f76afd6c74b57baf4c3edaf809e41, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.623096 13077 raft_consensus.cc:2258] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:23.623198 13039 consensus_queue.cc:260] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.623435 13039 ts_tablet_manager.cc:1428] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:23.623106 13038 tablet_bootstrap.cc:654] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.625747 13038 tablet_bootstrap.cc:492] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: No bootstrap required, opened a new log
I20260807 02:17:23.625857 13038 ts_tablet_manager.cc:1397] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 02:17:23.626410 13038 raft_consensus.cc:348] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.626526 13038 raft_consensus.cc:374] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.626566 13038 raft_consensus.cc:729] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.626744 13038 consensus_queue.cc:260] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.627032 13038 ts_tablet_manager.cc:1428] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:23.627275 13077 ts_tablet_manager.cc:1905] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:23.631147 13077 ts_tablet_manager.cc:1918] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:23.631259 13077 log.cc:1196] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/98a9765d787c4c2283d4eba3c2640b09
I20260807 02:17:23.631575 13077 ts_tablet_manager.cc:1939] T 98a9765d787c4c2283d4eba3c2640b09 P aa0bb88651884ec4aa1c53c0e1390185: Deleting consensus metadata
I20260807 02:17:23.631765 13041 tablet_bootstrap.cc:492] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: No bootstrap required, opened a new log
I20260807 02:17:23.631903 13041 ts_tablet_manager.cc:1397] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260807 02:17:23.632477 13041 raft_consensus.cc:348] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.632688 13041 raft_consensus.cc:374] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.632753 13041 raft_consensus.cc:729] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.632899 13041 consensus_queue.cc:260] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.633122 12280 catalog_manager.cc:4841] TS aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835): tablet 98a9765d787c4c2283d4eba3c2640b09 (table test-table [id=e8e8d192e9e545d2a11021542ebfe737]) successfully deleted
I20260807 02:17:23.633206 13041 ts_tablet_manager.cc:1428] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:23.807524 13050 raft_consensus.cc:482] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:23.807711 13050 raft_consensus.cc:504] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.808763 13050 leader_election.cc:288] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835), 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883)
I20260807 02:17:23.813041 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.809201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:34713 (local address 127.1.126.193:37835)
0807 02:17:23.809369 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.809375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.809482 (+ 107us) server_negotiation.cc:407] Connection header received
0807 02:17:23.809704 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.809708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.809760 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.809814 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.810282 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.810895 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.812039 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.812440 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.812561 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.812619 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.812829 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.812906 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 02:17:23.813053 13085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.809478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42883 (local address 127.1.126.195:50743)
0807 02:17:23.809740 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.809751 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.809837 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.810106 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.810108 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.810123 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.810262 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.810268 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.810994 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.810999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.811905 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.811914 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.812618 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.812623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.812726 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.812743 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.812842 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.812906 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":62,"thread_start_us":65,"threads_started":1}
I20260807 02:17:23.813059 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.809628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:50743 (local address 127.1.126.194:42883)
0807 02:17:23.809764 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.809768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.809812 (+ 44us) server_negotiation.cc:407] Connection header received
0807 02:17:23.809952 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.809955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.810008 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.810083 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:23.810380 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.810885 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.812078 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.812457 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.812594 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.812650 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.812881 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.812960 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:17:23.813063 13084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.809042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:37835 (local address 127.1.126.195:34713)
0807 02:17:23.809369 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.809385 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.809544 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.809997 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.810001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.810019 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:23.810157 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.810166 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.811029 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.811032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.811900 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.811909 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.812570 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.812574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.812686 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.812711 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.812780 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.812868 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":20,"thread_start_us":107,"threads_started":1}
I20260807 02:17:23.813767 12533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79ef36dab771448290c465b03fe895f8" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0bb88651884ec4aa1c53c0e1390185" is_pre_election: true
I20260807 02:17:23.813861 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79ef36dab771448290c465b03fe895f8" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" is_pre_election: true
I20260807 02:17:23.813941 12533 raft_consensus.cc:2454] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 0.
I20260807 02:17:23.814154 12737 raft_consensus.cc:2454] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 0.
I20260807 02:17:23.814364 12835 leader_election.cc:302] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:23.814621 13050 raft_consensus.cc:2781] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:23.814728 13050 raft_consensus.cc:482] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:23.814777 13050 raft_consensus.cc:3037] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:23.816069 13050 raft_consensus.cc:504] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.816417 13050 leader_election.cc:288] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 election: Requested vote from peers aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835), 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883)
I20260807 02:17:23.816828 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79ef36dab771448290c465b03fe895f8" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
I20260807 02:17:23.816828 12533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79ef36dab771448290c465b03fe895f8" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0bb88651884ec4aa1c53c0e1390185"
I20260807 02:17:23.816955 12737 raft_consensus.cc:3037] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:23.816955 12533 raft_consensus.cc:3037] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:23.818064 12737 raft_consensus.cc:2454] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 1.
I20260807 02:17:23.818064 12533 raft_consensus.cc:2454] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 1.
I20260807 02:17:23.818353 12835 leader_election.cc:302] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:23.818516 13050 raft_consensus.cc:2781] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:23.818771 13050 raft_consensus.cc:686] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 LEADER]: Becoming Leader. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Running, Role: LEADER
I20260807 02:17:23.819032 13050 consensus_queue.cc:237] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.821367 12300 catalog_manager.cc:5495] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195). New cstate: current_term: 1 leader_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } health_report { overall_health: HEALTHY } } }
Aug 07 02:17:23 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069042, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.254@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:23.893110 13097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.884534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:34175 (local address 127.0.0.1:38138)
0807 02:17:23.884965 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:23.884977 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:23.885082 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:23.885374 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:23.885377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:23.885762 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:23.885865 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.885870 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.886623 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.886626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.887255 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:23.887264 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.887682 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.887685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:23.887746 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.888377 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:23.888389 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:23.889885 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:23.891711 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:23.891719 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:23.891724 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:23.891963 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:23.892211 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:23.892213 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:23.892214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:23.892290 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:23.892635 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:23.892640 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:23.892740 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 02:17:23.892833 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 02:17:23.892954 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":132,"threads_started":1}
I20260807 02:17:23.893144 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:23.884584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38138 (local address 127.1.126.254:34175)
0807 02:17:23.884844 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:23.884851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:23.885049 (+ 198us) server_negotiation.cc:407] Connection header received
0807 02:17:23.885174 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:23.885177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:23.885220 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:23.885343 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:23.885972 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.886503 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.887357 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:23.887581 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:23.887661 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:23.890010 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:23.890013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:23.890015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:23.890036 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:23.891616 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.892053 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.892056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.892057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.892132 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:23.892368 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:23.892370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:23.892371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:23.892536 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:23.892611 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:23.892891 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 02:17:23.893013 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":184,"thread_start_us":101,"threads_started":1}
I20260807 02:17:23.897074 12300 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:38138:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 02:17:23.897768 12300 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:23.902396 12500 tablet_service.cc:1467] Processing CreateTablet for tablet 26f5b12b01444bae875c971f734298d0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e772bf38b92e408e95f46973f01e572b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:17:23.902429 12709 tablet_service.cc:1467] Processing CreateTablet for tablet 26f5b12b01444bae875c971f734298d0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e772bf38b92e408e95f46973f01e572b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:17:23.902561 12904 tablet_service.cc:1467] Processing CreateTablet for tablet 26f5b12b01444bae875c971f734298d0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e772bf38b92e408e95f46973f01e572b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 02:17:23.902835 12500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f5b12b01444bae875c971f734298d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.902844 12709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f5b12b01444bae875c971f734298d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.902927 12904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f5b12b01444bae875c971f734298d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:23.905427 13038 tablet_bootstrap.cc:492] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: Bootstrap starting.
I20260807 02:17:23.905545 13041 tablet_bootstrap.cc:492] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: Bootstrap starting.
I20260807 02:17:23.905637 13039 tablet_bootstrap.cc:492] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: Bootstrap starting.
I20260807 02:17:23.906237 13038 tablet_bootstrap.cc:654] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.906463 13039 tablet_bootstrap.cc:654] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.906463 13041 tablet_bootstrap.cc:654] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:23.907452 13038 tablet_bootstrap.cc:492] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: No bootstrap required, opened a new log
I20260807 02:17:23.907550 13038 ts_tablet_manager.cc:1397] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:23.907929 13039 tablet_bootstrap.cc:492] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: No bootstrap required, opened a new log
I20260807 02:17:23.908020 13039 ts_tablet_manager.cc:1397] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 02:17:23.908094 13041 tablet_bootstrap.cc:492] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: No bootstrap required, opened a new log
I20260807 02:17:23.908025 13038 raft_consensus.cc:348] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.908142 13038 raft_consensus.cc:374] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.908172 13041 ts_tablet_manager.cc:1397] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:17:23.908180 13038 raft_consensus.cc:729] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.908310 13038 consensus_queue.cc:260] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.908423 13039 raft_consensus.cc:348] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.908533 13039 raft_consensus.cc:374] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.908578 13039 raft_consensus.cc:729] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f76afd6c74b57baf4c3edaf809e41, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.908565 13041 raft_consensus.cc:348] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.908638 13038 ts_tablet_manager.cc:1428] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:23.908677 13041 raft_consensus.cc:374] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:23.908731 13041 raft_consensus.cc:729] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Initialized, Role: FOLLOWER
I20260807 02:17:23.908720 13039 consensus_queue.cc:260] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.908857 13041 consensus_queue.cc:260] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:23.909000 13039 ts_tablet_manager.cc:1428] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 02:17:23.909128 13041 ts_tablet_manager.cc:1428] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:23.909265 13068 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:23.909328 13048 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:23.909417 13068 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:23.909468 13048 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:23.909487 13050 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:23.909605 13050 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:24.119088 13048 raft_consensus.cc:482] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:24.119285 13048 raft_consensus.cc:504] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.120460 13048 leader_election.cc:288] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883), c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311)
I20260807 02:17:24.124590 13103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.120776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:37311 (local address 127.1.126.193:38857)
0807 02:17:24.121085 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:24.121099 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:24.121239 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:24.121503 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:24.121506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:24.121523 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:24.121690 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.121696 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.122594 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.122597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.123485 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.123494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.124139 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.124143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.124253 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.124276 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:17:24.124359 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:17:24.124413 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":19,"thread_start_us":62,"threads_started":1}
I20260807 02:17:24.124626 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.120852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38857 (local address 127.1.126.195:37311)
0807 02:17:24.121118 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.121123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.121163 (+ 40us) server_negotiation.cc:407] Connection header received
0807 02:17:24.121351 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.121354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.121394 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.121491 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:24.121811 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.122455 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.123633 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.124022 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.124109 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.124149 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.124404 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.124491 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":58,"threads_started":1}
I20260807 02:17:24.124699 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.120832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38167 (local address 127.1.126.194:42883)
0807 02:17:24.121081 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.121086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.121108 (+ 22us) server_negotiation.cc:407] Connection header received
0807 02:17:24.121318 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.121321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.121367 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.121463 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:24.121852 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.122386 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.123603 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.124128 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.124249 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.124298 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.124490 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.124558 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260807 02:17:24.124648 13104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.120740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42883 (local address 127.1.126.193:38167)
0807 02:17:24.121024 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:24.121040 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:24.121170 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:24.121492 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:24.121495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:24.121511 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:24.121702 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.121708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.122493 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.122500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.123473 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.123483 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.124254 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.124257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.124325 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.124377 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 02:17:24.124452 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 02:17:24.124510 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":46,"spinlock_wait_cycles":24448,"thread_start_us":89,"threads_started":1}
I20260807 02:17:24.125236 12930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f5b12b01444bae875c971f734298d0" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" is_pre_election: true
I20260807 02:17:24.125368 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f5b12b01444bae875c971f734298d0" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" is_pre_election: true
I20260807 02:17:24.125407 12930 raft_consensus.cc:2454] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 0.
I20260807 02:17:24.125502 12737 raft_consensus.cc:2454] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 0.
I20260807 02:17:24.125805 12432 leader_election.cc:302] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:24.126102 13048 raft_consensus.cc:2781] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:24.126173 13048 raft_consensus.cc:482] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:24.126214 13048 raft_consensus.cc:3037] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.127300 13048 raft_consensus.cc:504] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.127663 13048 leader_election.cc:288] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883), c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311)
I20260807 02:17:24.127980 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f5b12b01444bae875c971f734298d0" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
I20260807 02:17:24.128042 12930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f5b12b01444bae875c971f734298d0" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5211dc1375b4cbd8a1f33a12f43479e"
I20260807 02:17:24.128141 12737 raft_consensus.cc:3037] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.128159 12930 raft_consensus.cc:3037] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.128966 12930 raft_consensus.cc:2454] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 1.
I20260807 02:17:24.129127 12737 raft_consensus.cc:2454] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 1.
I20260807 02:17:24.129295 12432 leader_election.cc:302] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:24.129462 13048 raft_consensus.cc:2781] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:24.129662 13048 raft_consensus.cc:686] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 LEADER]: Becoming Leader. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Running, Role: LEADER
I20260807 02:17:24.129910 13048 consensus_queue.cc:237] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.131295 13111 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: TxnStatusTablet state changed. Reason: New leader aa0bb88651884ec4aa1c53c0e1390185. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.131398 13111 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:17:24.131635 13113 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 02:17:24.131794 13113 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 02:17:24.132419 12301 catalog_manager.cc:5495] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193). New cstate: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260807 02:17:24.145627 13097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.141156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:37835 (local address 127.0.0.1:59674)
0807 02:17:24.141394 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:24.141410 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:24.141526 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:24.141825 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:24.141828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:24.141854 (+ 26us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:17:24.141963 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.141970 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.142625 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.142629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.143615 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.143628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.144340 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.144344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.144472 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.144530 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.145327 (+ 797us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.145343 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 02:17:24.145404 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 02:17:24.145491 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 02:17:24.146092 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.141228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59674 (local address 127.1.126.193:37835)
0807 02:17:24.141345 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.141348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.141457 (+ 109us) server_negotiation.cc:407] Connection header received
0807 02:17:24.141656 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.141658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.141703 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.141780 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:24.142060 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.142519 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.143801 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.144159 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.144256 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.144724 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.145178 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.145281 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.145918 (+ 637us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.145974 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:17:24.148933 12930 raft_consensus.cc:1261] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Refusing update from remote peer aa0bb88651884ec4aa1c53c0e1390185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.149266 12737 raft_consensus.cc:1261] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Refusing update from remote peer aa0bb88651884ec4aa1c53c0e1390185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.149398 13048 consensus_queue.cc:1035] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.150007 13048 consensus_queue.cc:1035] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.150815 13050 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: TxnStatusTablet state changed. Reason: New leader aa0bb88651884ec4aa1c53c0e1390185. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.150931 13050 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:24.152626 13068 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: TxnStatusTablet state changed. Reason: New leader aa0bb88651884ec4aa1c53c0e1390185. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.152748 13068 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:24.156402 13111 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.156517 13111 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:17:24.157034 13068 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.157127 13068 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P 4b2f76afd6c74b57baf4c3edaf809e41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:24.158481 13122 mvcc.cc:205] Tried to move back new op lower bound from 7315738804829007872 to 7315738804758081536. Current Snapshot: MvccSnapshot[applied={T|T < 7315738804829007872}]
I20260807 02:17:24.159873 13111 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.159976 13111 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P aa0bb88651884ec4aa1c53c0e1390185: This TxnStatusTablet replica's current role is: LEADER
I20260807 02:17:24.161088 13050 tablet_replica.cc:439] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } } }
I20260807 02:17:24.161192 13050 tablet_replica.cc:442] T 26f5b12b01444bae875c971f734298d0 P c5211dc1375b4cbd8a1f33a12f43479e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 02:17:24.162896 13119 mvcc.cc:205] Tried to move back new op lower bound from 7315738804829007872 to 7315738804758081536. Current Snapshot: MvccSnapshot[applied={T|T < 7315738804829007872}]
I20260807 02:17:24.168532 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.164140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39656 (local address 127.1.126.195:37311)
0807 02:17:24.164248 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.164253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.164267 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:24.164465 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.164469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.164530 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.164639 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:24.164887 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.165716 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.166989 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.167313 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.167432 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.167662 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.168170 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.168284 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.168356 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.168417 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:17:24.178905 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.175411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:50533 (local address 127.1.126.193:37835)
0807 02:17:24.175579 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.175584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.175814 (+ 230us) server_negotiation.cc:407] Connection header received
0807 02:17:24.175912 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.175916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.175965 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.176044 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:24.176284 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.177020 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.177814 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.178136 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.178231 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.178475 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.178556 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.178626 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.178699 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.178777 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 02:17:24.179517 13136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.175277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:37835 (local address 127.1.126.195:50533)
0807 02:17:24.175727 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:24.175739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:24.175826 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:24.176059 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:24.176061 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:24.176067 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:17:24.176185 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.176189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.177122 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.177125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.177709 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.177717 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.178246 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.178248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.178317 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.178357 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.178635 (+ 278us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.178640 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 02:17:24.178687 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 02:17:24.178808 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":99,"threads_started":1}
I20260807 02:17:24.187131 12737 raft_consensus.cc:1261] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Refusing update from remote peer c5211dc1375b4cbd8a1f33a12f43479e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.187525 12533 raft_consensus.cc:1261] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Refusing update from remote peer c5211dc1375b4cbd8a1f33a12f43479e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.187593 13088 consensus_queue.cc:1035] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.187911 13050 consensus_queue.cc:1035] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.193097 13118 mvcc.cc:205] Tried to move back new op lower bound from 7315738804985774080 to 7315738803485298688. Current Snapshot: MvccSnapshot[applied={T|T < 7315738804985774080}]
I20260807 02:17:24.210891 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.207188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:56099 (local address 127.1.126.195:37311)
0807 02:17:24.207428 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.207433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.207446 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:24.207491 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.207494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.207546 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.207629 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:24.208127 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.208869 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.209752 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.209985 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.210096 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.210401 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.210477 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.210554 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.210690 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.210770 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260807 02:17:24.211354 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.206889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:37311 (local address 127.1.126.193:56099)
0807 02:17:24.207223 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:24.207240 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:24.207364 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:24.207879 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:24.207881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:24.207888 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 02:17:24.207998 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.208002 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.208980 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.208983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.209626 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:24.209635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.210101 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.210105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:24.210207 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.210251 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.210563 (+ 312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.210572 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 02:17:24.211100 (+ 528us) client_negotiation.cc:240] Negotiation successful
0807 02:17:24.211179 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":126,"threads_started":1}
I20260807 02:17:24.237771 12301 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:24.237934 12301 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:24.240098 12301 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Sending DeleteTablet for 3 replicas of tablet 79ef36dab771448290c465b03fe895f8
I20260807 02:17:24.240756 12709 tablet_service.cc:1514] Processing DeleteTablet for tablet 79ef36dab771448290c465b03fe895f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37560
I20260807 02:17:24.241016 12904 tablet_service.cc:1514] Processing DeleteTablet for tablet 79ef36dab771448290c465b03fe895f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:39644
I20260807 02:17:24.241360 13151 tablet_replica.cc:330] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: stopping tablet replica
I20260807 02:17:24.241408 12500 tablet_service.cc:1514] Processing DeleteTablet for tablet 79ef36dab771448290c465b03fe895f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:59660
I20260807 02:17:24.241510 13151 raft_consensus.cc:2229] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:24.241849 13151 raft_consensus.cc:2258] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.242270 13149 tablet_replica.cc:330] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: stopping tablet replica
I20260807 02:17:24.242425 13149 raft_consensus.cc:2229] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:24.242568 13149 raft_consensus.cc:2258] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.243403 13149 ts_tablet_manager.cc:1905] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.243808 13155 tablet_replica.cc:330] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: stopping tablet replica
I20260807 02:17:24.243966 13155 raft_consensus.cc:2229] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:24.244143 13155 raft_consensus.cc:2258] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.245462 13155 ts_tablet_manager.cc:1905] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.247449 13151 ts_tablet_manager.cc:1905] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.254971 13151 ts_tablet_manager.cc:1918] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:17:24.255070 13151 log.cc:1196] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/79ef36dab771448290c465b03fe895f8
I20260807 02:17:24.255374 13151 ts_tablet_manager.cc:1939] T 79ef36dab771448290c465b03fe895f8 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting consensus metadata
I20260807 02:17:24.256296 12281 catalog_manager.cc:4841] TS c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311): tablet 79ef36dab771448290c465b03fe895f8 (table test-table [id=815afc02f01240e4ad98bbaad17551fc]) successfully deleted
I20260807 02:17:24.261081 13155 ts_tablet_manager.cc:1918] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:17:24.261199 13155 log.cc:1196] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/79ef36dab771448290c465b03fe895f8
I20260807 02:17:24.261507 13155 ts_tablet_manager.cc:1939] T 79ef36dab771448290c465b03fe895f8 P aa0bb88651884ec4aa1c53c0e1390185: Deleting consensus metadata
I20260807 02:17:24.262352 12280 catalog_manager.cc:4841] TS aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835): tablet 79ef36dab771448290c465b03fe895f8 (table test-table [id=815afc02f01240e4ad98bbaad17551fc]) successfully deleted
I20260807 02:17:24.263746 13149 ts_tablet_manager.cc:1918] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:17:24.263867 13149 log.cc:1196] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/79ef36dab771448290c465b03fe895f8
I20260807 02:17:24.264169 13149 ts_tablet_manager.cc:1939] T 79ef36dab771448290c465b03fe895f8 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting consensus metadata
I20260807 02:17:24.265097 12280 catalog_manager.cc:4841] TS 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883): tablet 79ef36dab771448290c465b03fe895f8 (table test-table [id=815afc02f01240e4ad98bbaad17551fc]) successfully deleted
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 02:17:24.287488 13098 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:24.278574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38148 (local address 127.1.126.254:34175)
0807 02:17:24.278763 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.278769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.278936 (+ 167us) server_negotiation.cc:407] Connection header received
0807 02:17:24.279196 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.279203 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.279277 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.279352 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:24.280524 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.281410 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.282791 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.283153 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.283247 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.287311 (+ 4064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38148: BlockingRecv error: recv got EOF from 127.0.0.1:38148 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM
I20260807 02:17:24.306684 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.289826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38160 (local address 127.1.126.254:34175)
0807 02:17:24.289944 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.289948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.295005 (+ 5057us) server_negotiation.cc:407] Connection header received
0807 02:17:24.295206 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.295212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.295278 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.295367 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:24.296323 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.297102 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.298401 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.298763 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.298853 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.302219 (+ 3366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:24.302226 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:24.302232 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:24.302268 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:24.304358 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:24.304928 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:24.304935 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:24.304937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:24.305034 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:24.305422 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:24.305428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:24.305432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:24.305725 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:24.305860 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.306308 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.306459 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:17:24.309808 12301 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:24.310282 12301 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:24.316357 12500 tablet_service.cc:1467] Processing CreateTablet for tablet 65d3505d21a0438eb182730f596a4de6 (DEFAULT_TABLE table=test-table [id=020bd9ab184543909a6f4f9b0ff416cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:24.316684 12500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65d3505d21a0438eb182730f596a4de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:24.316663 12709 tablet_service.cc:1467] Processing CreateTablet for tablet 65d3505d21a0438eb182730f596a4de6 (DEFAULT_TABLE table=test-table [id=020bd9ab184543909a6f4f9b0ff416cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:24.316926 12709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65d3505d21a0438eb182730f596a4de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:24.319494 13038 tablet_bootstrap.cc:492] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Bootstrap starting.
I20260807 02:17:24.319514 12904 tablet_service.cc:1467] Processing CreateTablet for tablet 65d3505d21a0438eb182730f596a4de6 (DEFAULT_TABLE table=test-table [id=020bd9ab184543909a6f4f9b0ff416cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:24.319794 12904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65d3505d21a0438eb182730f596a4de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:24.320443 13038 tablet_bootstrap.cc:654] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:24.321858 13038 tablet_bootstrap.cc:492] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: No bootstrap required, opened a new log
I20260807 02:17:24.321951 13038 ts_tablet_manager.cc:1397] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:24.322429 13039 tablet_bootstrap.cc:492] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Bootstrap starting.
I20260807 02:17:24.322391 13038 raft_consensus.cc:348] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.322500 13038 raft_consensus.cc:374] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:24.322531 13038 raft_consensus.cc:729] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Initialized, Role: FOLLOWER
I20260807 02:17:24.322650 13038 consensus_queue.cc:260] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.322929 13038 ts_tablet_manager.cc:1428] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:24.323331 13039 tablet_bootstrap.cc:654] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:24.323935 13041 tablet_bootstrap.cc:492] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Bootstrap starting.
I20260807 02:17:24.324851 13041 tablet_bootstrap.cc:654] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:24.326103 13041 tablet_bootstrap.cc:492] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: No bootstrap required, opened a new log
I20260807 02:17:24.326220 13041 ts_tablet_manager.cc:1397] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:24.327174 13048 raft_consensus.cc:482] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:24.327273 13048 raft_consensus.cc:504] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.327718 13048 leader_election.cc:288] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883), c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311)
I20260807 02:17:24.328011 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d3505d21a0438eb182730f596a4de6" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" is_pre_election: true
W20260807 02:17:24.328547 12431 leader_election.cc:341] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883): Illegal state: must be running to vote when last-logged opid is not known
I20260807 02:17:24.329721 12930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d3505d21a0438eb182730f596a4de6" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" is_pre_election: true
I20260807 02:17:24.329969 13039 tablet_bootstrap.cc:492] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: No bootstrap required, opened a new log
I20260807 02:17:24.330054 13039 ts_tablet_manager.cc:1397] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260807 02:17:24.330477 13039 raft_consensus.cc:348] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.330591 13039 raft_consensus.cc:374] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:24.330648 13039 raft_consensus.cc:729] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f76afd6c74b57baf4c3edaf809e41, State: Initialized, Role: FOLLOWER
I20260807 02:17:24.326671 13041 raft_consensus.cc:348] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.330796 13041 raft_consensus.cc:374] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:24.330849 13041 raft_consensus.cc:729] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Initialized, Role: FOLLOWER
I20260807 02:17:24.330816 13039 consensus_queue.cc:260] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.330963 13041 consensus_queue.cc:260] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.331112 13039 ts_tablet_manager.cc:1428] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:24.331154 12930 raft_consensus.cc:2454] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 0.
I20260807 02:17:24.331781 12432 leader_election.cc:302] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters: 4b2f76afd6c74b57baf4c3edaf809e41
I20260807 02:17:24.332214 13048 raft_consensus.cc:2781] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:24.332306 13048 raft_consensus.cc:482] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:24.332358 13048 raft_consensus.cc:3037] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.333582 13048 raft_consensus.cc:504] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.334012 13048 leader_election.cc:288] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 election: Requested vote from peers 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883), c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311)
I20260807 02:17:24.334272 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d3505d21a0438eb182730f596a4de6" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
I20260807 02:17:24.334394 12737 raft_consensus.cc:3037] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.334969 12930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d3505d21a0438eb182730f596a4de6" candidate_uuid: "aa0bb88651884ec4aa1c53c0e1390185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5211dc1375b4cbd8a1f33a12f43479e"
I20260807 02:17:24.335099 12930 raft_consensus.cc:3037] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.335443 12737 raft_consensus.cc:2454] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 1.
I20260807 02:17:24.336103 12431 leader_election.cc:302] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2f76afd6c74b57baf4c3edaf809e41, aa0bb88651884ec4aa1c53c0e1390185; no voters:
I20260807 02:17:24.336428 12930 raft_consensus.cc:2454] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0bb88651884ec4aa1c53c0e1390185 in term 1.
I20260807 02:17:24.336539 13048 raft_consensus.cc:2781] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:24.336624 13048 raft_consensus.cc:686] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 LEADER]: Becoming Leader. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Running, Role: LEADER
I20260807 02:17:24.336752 13048 consensus_queue.cc:237] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.338547 13041 ts_tablet_manager.cc:1428] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260807 02:17:24.338445 12299 catalog_manager.cc:5495] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193). New cstate: current_term: 1 leader_uuid: "aa0bb88651884ec4aa1c53c0e1390185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260807 02:17:24.350150 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.346764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59676 (local address 127.1.126.193:37835)
0807 02:17:24.346882 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.346886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.346901 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:24.347029 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.347032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.347080 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.347162 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:24.347425 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.348216 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.349019 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.349363 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.349469 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.349712 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.349804 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.349876 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.349955 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.350020 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:17:24.352545 12930 raft_consensus.cc:1261] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Refusing update from remote peer aa0bb88651884ec4aa1c53c0e1390185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.352571 12737 raft_consensus.cc:1261] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Refusing update from remote peer aa0bb88651884ec4aa1c53c0e1390185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.352985 13111 consensus_queue.cc:1035] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.353155 13048 consensus_queue.cc:1035] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.366261 12301 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:24.366407 12301 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:24.368742 12301 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Sending DeleteTablet for 3 replicas of tablet 65d3505d21a0438eb182730f596a4de6
I20260807 02:17:24.369375 12904 tablet_service.cc:1514] Processing DeleteTablet for tablet 65d3505d21a0438eb182730f596a4de6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:39644
I20260807 02:17:24.369544 13151 tablet_replica.cc:330] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: stopping tablet replica
I20260807 02:17:24.369509 12709 tablet_service.cc:1514] Processing DeleteTablet for tablet 65d3505d21a0438eb182730f596a4de6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37560
I20260807 02:17:24.369648 13151 raft_consensus.cc:2229] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:24.369765 13151 raft_consensus.cc:2258] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.369814 12500 tablet_service.cc:1514] Processing DeleteTablet for tablet 65d3505d21a0438eb182730f596a4de6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:59660
I20260807 02:17:24.369916 13149 tablet_replica.cc:330] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: stopping tablet replica
I20260807 02:17:24.370026 13149 raft_consensus.cc:2229] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:24.370144 13149 raft_consensus.cc:2258] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.370290 13155 tablet_replica.cc:330] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: stopping tablet replica
I20260807 02:17:24.370388 13155 raft_consensus.cc:2229] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:24.370632 13155 raft_consensus.cc:2258] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.370620 12301 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:24.371027 12301 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:24.372340 13155 ts_tablet_manager.cc:1905] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.374883 13155 ts_tablet_manager.cc:1918] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:24.374960 13155 log.cc:1196] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/65d3505d21a0438eb182730f596a4de6
I20260807 02:17:24.375212 13155 ts_tablet_manager.cc:1939] T 65d3505d21a0438eb182730f596a4de6 P aa0bb88651884ec4aa1c53c0e1390185: Deleting consensus metadata
I20260807 02:17:24.375777 12904 tablet_service.cc:1467] Processing CreateTablet for tablet b3d91208d9674add8ea44d4fdbcea0af (DEFAULT_TABLE table=test-table [id=6ffe0c19511040b6a9ee8e1cd30f24f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:24.376066 12904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3d91208d9674add8ea44d4fdbcea0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:24.376559 13151 ts_tablet_manager.cc:1905] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.378693 13151 ts_tablet_manager.cc:1918] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:24.378780 13151 log.cc:1196] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/65d3505d21a0438eb182730f596a4de6
I20260807 02:17:24.379020 13151 ts_tablet_manager.cc:1939] T 65d3505d21a0438eb182730f596a4de6 P c5211dc1375b4cbd8a1f33a12f43479e: Deleting consensus metadata
I20260807 02:17:24.379173 12709 tablet_service.cc:1467] Processing CreateTablet for tablet b3d91208d9674add8ea44d4fdbcea0af (DEFAULT_TABLE table=test-table [id=6ffe0c19511040b6a9ee8e1cd30f24f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:24.379442 12709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3d91208d9674add8ea44d4fdbcea0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:24.379684 12281 catalog_manager.cc:4841] TS c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311): tablet 65d3505d21a0438eb182730f596a4de6 (table test-table [id=020bd9ab184543909a6f4f9b0ff416cb]) successfully deleted
I20260807 02:17:24.380446 13149 ts_tablet_manager.cc:1905] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.381865 13039 tablet_bootstrap.cc:492] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Bootstrap starting.
I20260807 02:17:24.382725 13149 ts_tablet_manager.cc:1918] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:24.382797 13149 log.cc:1196] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/65d3505d21a0438eb182730f596a4de6
I20260807 02:17:24.382797 13039 tablet_bootstrap.cc:654] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:24.383054 13149 ts_tablet_manager.cc:1939] T 65d3505d21a0438eb182730f596a4de6 P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting consensus metadata
I20260807 02:17:24.383843 12500 tablet_service.cc:1467] Processing CreateTablet for tablet b3d91208d9674add8ea44d4fdbcea0af (DEFAULT_TABLE table=test-table [id=6ffe0c19511040b6a9ee8e1cd30f24f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:24.384122 12500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3d91208d9674add8ea44d4fdbcea0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:24.386538 13038 tablet_bootstrap.cc:492] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Bootstrap starting.
I20260807 02:17:24.386731 12280 catalog_manager.cc:4841] TS aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835): tablet 65d3505d21a0438eb182730f596a4de6 (table test-table [id=020bd9ab184543909a6f4f9b0ff416cb]) successfully deleted
I20260807 02:17:24.386989 12280 catalog_manager.cc:4841] TS 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883): tablet 65d3505d21a0438eb182730f596a4de6 (table test-table [id=020bd9ab184543909a6f4f9b0ff416cb]) successfully deleted
I20260807 02:17:24.387372 13038 tablet_bootstrap.cc:654] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:24.387630 13041 tablet_bootstrap.cc:492] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Bootstrap starting.
I20260807 02:17:24.388543 13038 tablet_bootstrap.cc:492] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: No bootstrap required, opened a new log
I20260807 02:17:24.388621 13038 ts_tablet_manager.cc:1397] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:24.388621 13041 tablet_bootstrap.cc:654] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:24.389000 13038 raft_consensus.cc:348] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.389134 13038 raft_consensus.cc:374] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:24.389166 13038 raft_consensus.cc:729] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0bb88651884ec4aa1c53c0e1390185, State: Initialized, Role: FOLLOWER
I20260807 02:17:24.389277 13038 consensus_queue.cc:260] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.389539 13038 ts_tablet_manager.cc:1428] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 02:17:24.389976 13039 tablet_bootstrap.cc:492] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: No bootstrap required, opened a new log
I20260807 02:17:24.390075 13039 ts_tablet_manager.cc:1397] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20260807 02:17:24.390502 13039 raft_consensus.cc:348] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.390625 13039 raft_consensus.cc:374] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:24.390669 13039 raft_consensus.cc:729] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2f76afd6c74b57baf4c3edaf809e41, State: Initialized, Role: FOLLOWER
I20260807 02:17:24.390832 13039 consensus_queue.cc:260] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.391113 13039 ts_tablet_manager.cc:1428] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 02:17:24.393567 13041 tablet_bootstrap.cc:492] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: No bootstrap required, opened a new log
I20260807 02:17:24.393679 13041 ts_tablet_manager.cc:1397] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260807 02:17:24.394062 13041 raft_consensus.cc:348] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.394155 13041 raft_consensus.cc:374] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:24.394215 13041 raft_consensus.cc:729] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Initialized, Role: FOLLOWER
I20260807 02:17:24.394543 13041 consensus_queue.cc:260] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.395394 13041 ts_tablet_manager.cc:1428] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 02:17:24.411629 13145 raft_consensus.cc:482] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:24.411773 13145 raft_consensus.cc:504] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.412258 13145 leader_election.cc:288] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835), 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883)
I20260807 02:17:24.412699 12533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3d91208d9674add8ea44d4fdbcea0af" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0bb88651884ec4aa1c53c0e1390185" is_pre_election: true
I20260807 02:17:24.412868 12533 raft_consensus.cc:2454] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 0.
I20260807 02:17:24.412863 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3d91208d9674add8ea44d4fdbcea0af" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" is_pre_election: true
I20260807 02:17:24.412995 12737 raft_consensus.cc:2454] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 0.
I20260807 02:17:24.413385 12835 leader_election.cc:302] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:24.413576 13145 raft_consensus.cc:2781] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:24.413632 13145 raft_consensus.cc:482] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:24.413672 13145 raft_consensus.cc:3037] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.414860 13145 raft_consensus.cc:504] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.415251 13145 leader_election.cc:288] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 election: Requested vote from peers aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835), 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883)
I20260807 02:17:24.415567 12533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3d91208d9674add8ea44d4fdbcea0af" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0bb88651884ec4aa1c53c0e1390185"
I20260807 02:17:24.415691 12533 raft_consensus.cc:3037] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.416543 12533 raft_consensus.cc:2454] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 1.
I20260807 02:17:24.416821 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3d91208d9674add8ea44d4fdbcea0af" candidate_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2f76afd6c74b57baf4c3edaf809e41"
I20260807 02:17:24.416867 12835 leader_election.cc:302] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa0bb88651884ec4aa1c53c0e1390185, c5211dc1375b4cbd8a1f33a12f43479e; no voters:
I20260807 02:17:24.416946 12737 raft_consensus.cc:3037] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:24.417802 12737 raft_consensus.cc:2454] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5211dc1375b4cbd8a1f33a12f43479e in term 1.
I20260807 02:17:24.418015 13145 raft_consensus.cc:2781] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:24.418115 13145 raft_consensus.cc:686] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 1 LEADER]: Becoming Leader. State: Replica: c5211dc1375b4cbd8a1f33a12f43479e, State: Running, Role: LEADER
I20260807 02:17:24.418249 13145 consensus_queue.cc:237] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } }
I20260807 02:17:24.420213 12301 catalog_manager.cc:5495] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195). New cstate: current_term: 1 leader_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5211dc1375b4cbd8a1f33a12f43479e" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37311 } health_report { overall_health: HEALTHY } } }
I20260807 02:17:24.442634 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:24.439549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39660 (local address 127.1.126.195:37311)
0807 02:17:24.439658 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:24.439663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:24.439701 (+ 38us) server_negotiation.cc:407] Connection header received
0807 02:17:24.439864 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:24.439868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:24.439923 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:24.439997 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:24.440241 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.440753 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.441604 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:24.441818 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:24.441923 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:24.442186 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:24.442262 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:24.442344 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:24.442435 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 02:17:24.442482 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 02:17:24.449427 12533 raft_consensus.cc:1261] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Refusing update from remote peer c5211dc1375b4cbd8a1f33a12f43479e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.449995 12737 raft_consensus.cc:1261] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Refusing update from remote peer c5211dc1375b4cbd8a1f33a12f43479e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:24.450474 13088 consensus_queue.cc:1035] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0bb88651884ec4aa1c53c0e1390185" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 37835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.450843 13088 consensus_queue.cc:1035] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2f76afd6c74b57baf4c3edaf809e41" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:24.487950 12299 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:24.488140 12299 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:24.490072 12299 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f2a284852a84eb79778939f363b8ae5: Sending DeleteTablet for 3 replicas of tablet b3d91208d9674add8ea44d4fdbcea0af
I20260807 02:17:24.490586 12500 tablet_service.cc:1514] Processing DeleteTablet for tablet b3d91208d9674add8ea44d4fdbcea0af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:59660
I20260807 02:17:24.490811 13155 tablet_replica.cc:330] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: stopping tablet replica
I20260807 02:17:24.490809 12709 tablet_service.cc:1514] Processing DeleteTablet for tablet b3d91208d9674add8ea44d4fdbcea0af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37560
I20260807 02:17:24.490928 13155 raft_consensus.cc:2229] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:24.490974 13149 tablet_replica.cc:330] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: stopping tablet replica
I20260807 02:17:24.491051 13155 raft_consensus.cc:2258] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.491107 13149 raft_consensus.cc:2229] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:24.491217 13149 raft_consensus.cc:2258] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.490685 12904 tablet_service.cc:1514] Processing DeleteTablet for tablet b3d91208d9674add8ea44d4fdbcea0af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:24 UTC) from {username='oryx', principal='oryx/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:39644
I20260807 02:17:24.491508 13151 tablet_replica.cc:330] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: stopping tablet replica
I20260807 02:17:24.491662 13151 raft_consensus.cc:2229] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:24.491787 13155 ts_tablet_manager.cc:1905] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.491875 13151 raft_consensus.cc:2258] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:24.492548 13151 ts_tablet_manager.cc:1905] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.493240 13149 ts_tablet_manager.cc:1905] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:24.494297 13155 ts_tablet_manager.cc:1918] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:17:24.494364 13155 log.cc:1196] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/b3d91208d9674add8ea44d4fdbcea0af
I20260807 02:17:24.494621 13155 ts_tablet_manager.cc:1939] T b3d91208d9674add8ea44d4fdbcea0af P aa0bb88651884ec4aa1c53c0e1390185: Deleting consensus metadata
I20260807 02:17:24.495168 13151 ts_tablet_manager.cc:1918] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:17:24.495234 13151 log.cc:1196] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/b3d91208d9674add8ea44d4fdbcea0af
I20260807 02:17:24.495478 13151 ts_tablet_manager.cc:1939] T b3d91208d9674add8ea44d4fdbcea0af P c5211dc1375b4cbd8a1f33a12f43479e: Deleting consensus metadata
I20260807 02:17:24.496050 13149 ts_tablet_manager.cc:1918] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 02:17:24.496119 13149 log.cc:1196] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/b3d91208d9674add8ea44d4fdbcea0af
I20260807 02:17:24.496202 12281 catalog_manager.cc:4841] TS c5211dc1375b4cbd8a1f33a12f43479e (127.1.126.195:37311): tablet b3d91208d9674add8ea44d4fdbcea0af (table test-table [id=6ffe0c19511040b6a9ee8e1cd30f24f0]) successfully deleted
I20260807 02:17:24.496388 13149 ts_tablet_manager.cc:1939] T b3d91208d9674add8ea44d4fdbcea0af P 4b2f76afd6c74b57baf4c3edaf809e41: Deleting consensus metadata
I20260807 02:17:24.496443 12280 catalog_manager.cc:4841] TS aa0bb88651884ec4aa1c53c0e1390185 (127.1.126.193:37835): tablet b3d91208d9674add8ea44d4fdbcea0af (table test-table [id=6ffe0c19511040b6a9ee8e1cd30f24f0]) successfully deleted
I20260807 02:17:24.496742 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 12405
I20260807 02:17:24.502461 12280 catalog_manager.cc:4841] TS 4b2f76afd6c74b57baf4c3edaf809e41 (127.1.126.194:42883): tablet b3d91208d9674add8ea44d4fdbcea0af (table test-table [id=6ffe0c19511040b6a9ee8e1cd30f24f0]) successfully deleted
I20260807 02:17:24.510079 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 12612
I20260807 02:17:24.522073 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 12809
I20260807 02:17:24.535323 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 12253
2026-08-07T02:17:24Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3663 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[13200](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[13200](info): set up 2 sockets
Aug 07 02:17:24 dist-test-slave-39l8 krb5kdc[13200](info): commencing operation
krb5kdc: starting...
W20260807 02:17:25.733503 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:25 dist-test-slave-39l8 krb5kdc[13200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:25.853267 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45269
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:39977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:25.965291 13219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:25.965553 13219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:25.965637 13219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:25.969576 13219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:25.969635 13219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:25.969655 13219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:25.969708 13219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:25.969730 13219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:25.975054 13219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:25.976140 13219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:25.977185 13219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:25.985819 13231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:25.985808 13230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:25.985911 13219 server_base.cc:1034] running on GCE node
W20260807 02:17:25.985808 13233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:25.986644 13219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:25.987708 13219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:25.988901 13219 hybrid_clock.cc:648] HybridClock initialized: now 1786069045988875 us; error 38 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T02:17:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1457 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:26 dist-test-slave-39l8 krb5kdc[13244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:26 dist-test-slave-39l8 krb5kdc[13244](info): set up 2 sockets
Aug 07 02:17:26 dist-test-slave-39l8 krb5kdc[13244](info): commencing operation
krb5kdc: starting...
W20260807 02:17:27.199672 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:27.319288 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38189
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:38189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:27.429052 13266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:27.429317 13266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:27.429387 13266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:27.433259 13266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:27.433350 13266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:27.433389 13266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:27.433462 13266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:27.433501 13266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:27.438369 13266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:38189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:27.439332 13266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:27.440354 13266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:27.448469 13272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:27.448510 13277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:27.448530 13266 server_base.cc:1034] running on GCE node
W20260807 02:17:27.448482 13273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:27.449158 13266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:27.450212 13266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:27.451380 13266 hybrid_clock.cc:648] HybridClock initialized: now 1786069047451359 us; error 45 us; skew 500 ppm
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:27.454098 13266 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:27.455006 13266 webserver.cc:460] Webserver started at http://127.1.126.254:46793/ using document root <none> and password file <none>
I20260807 02:17:27.455530 13266 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:27.455629 13266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:27.455852 13266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:27.457794 13266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "7bd70a2f34bd477fba4dcee0192a821a"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "0306a2049eb6def372dfa451114a9fe3"
server_key_iv: "1de941356ec28c5e4f7881a338be0747"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.458357 13266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "7bd70a2f34bd477fba4dcee0192a821a"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "0306a2049eb6def372dfa451114a9fe3"
server_key_iv: "1de941356ec28c5e4f7881a338be0747"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.462054 13266 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:27.464411 13284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.465487 13266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 02:17:27.465610 13266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "7bd70a2f34bd477fba4dcee0192a821a"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "0306a2049eb6def372dfa451114a9fe3"
server_key_iv: "1de941356ec28c5e4f7881a338be0747"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.465718 13266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:27.476651 13266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:27.479833 13266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:27.480033 13266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:27.487138 13266 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:38189
I20260807 02:17:27.487174 13365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:38189 every 8 connection(s)
I20260807 02:17:27.488078 13266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:27.490674 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:27.495010 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 13266
I20260807 02:17:27.495167 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:27.495479 1531 external_mini_cluster.cc:1428] Setting key 292c882eb49cf4d958f58e7b3b60b5c9
I20260807 02:17:27.496198 13366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Bootstrap starting.
I20260807 02:17:27.498395 13366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:27.499162 13366 log.cc:824] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:27.500857 13366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: No bootstrap required, opened a new log
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:27.504946 13366 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:27.505236 13366 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:27.505298 13366 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd70a2f34bd477fba4dcee0192a821a, State: Initialized, Role: FOLLOWER
I20260807 02:17:27.505801 13366 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:27.505963 13366 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:27.506044 13366 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:27.506136 13366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:27.507275 13366 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:27.507680 13366 leader_election.cc:302] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bd70a2f34bd477fba4dcee0192a821a; no voters:
I20260807 02:17:27.508019 13366 leader_election.cc:288] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:27.508200 13372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:27.508433 13372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 LEADER]: Becoming Leader. State: Replica: 7bd70a2f34bd477fba4dcee0192a821a, State: Running, Role: LEADER
I20260807 02:17:27.508752 13372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:27.509181 13366 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:27.509946 13372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bd70a2f34bd477fba4dcee0192a821a. Latest consensus state: current_term: 1 leader_uuid: "7bd70a2f34bd477fba4dcee0192a821a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } } }
I20260807 02:17:27.510058 13372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:27.510433 13380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:27.510398 13373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bd70a2f34bd477fba4dcee0192a821a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } } }
I20260807 02:17:27.510538 13373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:27.510583 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:27.496790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34228 (local address 127.1.126.254:38189)
0807 02:17:27.497207 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:27.497220 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:27.497253 (+ 33us) server_negotiation.cc:407] Connection header received
0807 02:17:27.497827 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:27.497842 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:27.498138 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:27.498445 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:27.499269 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.500214 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.501041 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.501691 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.501879 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:27.504550 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:27.504556 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:27.504571 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:27.504601 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:27.506640 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:27.507228 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:27.507237 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:27.507244 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:27.507425 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:27.507795 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:27.507800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:27.507803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:27.508323 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:27.509185 (+ 862us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:27.509346 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 02:17:27.509632 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":120,"threads_started":1}
I20260807 02:17:27.514050 13380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:27.519454 13380 catalog_manager.cc:1347] Generated new cluster ID: 585f69ed854f4d1b94d3a54b292afe84
I20260807 02:17:27.519523 13380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:27.527079 13380 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:27.527856 13380 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:27.534183 13380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Generated new TSK 0
I20260807 02:17:27.534881 13380 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:27.567627 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38189
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:27.677637 13406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:27.677856 13406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:27.677896 13406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:27.681582 13406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:27.681632 13406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:27.681684 13406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:27.686499 13406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:27.687434 13406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:27.688374 13406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:27.697690 13414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:27.697710 13412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:27.697747 13406 server_base.cc:1034] running on GCE node
W20260807 02:17:27.697700 13416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:27.698282 13406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:27.698873 13406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:27.700027 13406 hybrid_clock.cc:648] HybridClock initialized: now 1786069047700010 us; error 29 us; skew 500 ppm
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:27.702833 13406 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:27.703594 13406 webserver.cc:460] Webserver started at http://127.1.126.193:41537/ using document root <none> and password file <none>
I20260807 02:17:27.704089 13406 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:27.704144 13406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:27.704295 13406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:27.706095 13406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "c8dec82af86142409770a0acf925aea4"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "243b41bd3ddd20c218738aaace55d213"
server_key_iv: "56a77b40d91afafe538a3d1c37459c80"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.706539 13406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "c8dec82af86142409770a0acf925aea4"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "243b41bd3ddd20c218738aaace55d213"
server_key_iv: "56a77b40d91afafe538a3d1c37459c80"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.709966 13406 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:17:27.712330 13425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.713454 13406 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:27.713570 13406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "c8dec82af86142409770a0acf925aea4"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "243b41bd3ddd20c218738aaace55d213"
server_key_iv: "56a77b40d91afafe538a3d1c37459c80"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.713665 13406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:27.729450 13406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:27.732141 13406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:27.732355 13406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:27.732897 13406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:27.733711 13406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:27.733757 13406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.733834 13406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:27.733872 13406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.742202 13406 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:34027
I20260807 02:17:27.742268 13591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:34027 every 8 connection(s)
I20260807 02:17:27.743072 13406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:27.743726 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 13406
I20260807 02:17:27.743857 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:27.744171 1531 external_mini_cluster.cc:1428] Setting key 0e116b9717f70ae83259a080e47ff839
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:17:27.756925 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:27.744890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:41267 (local address 127.1.126.254:38189)
0807 02:17:27.745035 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:27.745039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:27.746238 (+ 1199us) server_negotiation.cc:407] Connection header received
0807 02:17:27.747523 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:27.747525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:27.747567 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:27.747634 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:27.748812 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.749325 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.750469 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.750933 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.751057 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:27.753411 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:27.753418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:27.753422 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:27.753451 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:27.755022 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:27.755525 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:27.755531 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:27.755535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:27.755623 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:27.755906 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:27.755908 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:27.755910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:27.756086 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:27.756176 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:27.756707 (+ 531us) server_negotiation.cc:299] Negotiation successful
0807 02:17:27.756807 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:17:27.757844 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:27.745300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:41267)
0807 02:17:27.746096 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:27.746153 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:27.747316 (+ 1163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:27.747805 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:27.747816 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:27.748233 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:27.748667 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:27.748680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.749479 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.749482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:27.750342 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:27.750352 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.751105 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.751108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:27.751252 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:27.751804 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:27.751819 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:27.753226 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:27.755134 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:27.755138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:27.755148 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:27.755428 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:27.755710 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:27.755712 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:27.755713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:27.755829 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:27.756185 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:27.756189 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:27.756438 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 02:17:27.756664 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 02:17:27.756905 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":174,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:17:27.759105 13592 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38189
I20260807 02:17:27.759356 13592 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:27.759933 13592 heartbeater.cc:511] Master 127.1.126.254:38189 requested a full tablet report, sending...
I20260807 02:17:27.761708 13313 ts_manager.cc:194] Registered new tserver with Master: c8dec82af86142409770a0acf925aea4 (127.1.126.193:34027)
I20260807 02:17:27.762905 13313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:41267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:27.773339 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38189
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:27.884543 13602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:27.884812 13602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:27.884855 13602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:27.888897 13602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:27.888953 13602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:27.889011 13602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:27.894208 13602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:27.895169 13602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:27.896108 13602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:27.905740 13602 server_base.cc:1034] running on GCE node
W20260807 02:17:27.905779 13609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:27.905797 13616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:27.905886 13607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:27.906365 13602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:27.907068 13602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:27.908252 13602 hybrid_clock.cc:648] HybridClock initialized: now 1786069047908225 us; error 42 us; skew 500 ppm
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:27.911254 13602 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:27.912276 13602 webserver.cc:460] Webserver started at http://127.1.126.194:34905/ using document root <none> and password file <none>
I20260807 02:17:27.912850 13602 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:27.912942 13602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:27.913182 13602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:27.915274 13602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "253e39223ada44aa9a8d51fb148266fc"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "703f261c5cd8a6eb7489796b37d5acc9"
server_key_iv: "072c3046ac53b5a9b759ebad46d47d34"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.915882 13602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "253e39223ada44aa9a8d51fb148266fc"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "703f261c5cd8a6eb7489796b37d5acc9"
server_key_iv: "072c3046ac53b5a9b759ebad46d47d34"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.919755 13602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:17:27.922191 13627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.923427 13602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:27.923581 13602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "253e39223ada44aa9a8d51fb148266fc"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "703f261c5cd8a6eb7489796b37d5acc9"
server_key_iv: "072c3046ac53b5a9b759ebad46d47d34"
server_key_version: "encryptionkey@0"
I20260807 02:17:27.923696 13602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:27.939286 13602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:27.942054 13602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:27.942268 13602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:27.942915 13602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:27.943728 13602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:27.943799 13602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.943866 13602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:27.943914 13602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:27.952513 13602 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:36991
I20260807 02:17:27.952544 13797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:36991 every 8 connection(s)
I20260807 02:17:27.953346 13602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:27.959965 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 13602
I20260807 02:17:27.960115 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:27.960461 1531 external_mini_cluster.cc:1428] Setting key 5a150c3676f28cc15ea353411dff86e3
Aug 07 02:17:27 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:27.966333 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:27.955029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:44469 (local address 127.1.126.254:38189)
0807 02:17:27.955150 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:27.955155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:27.956193 (+ 1038us) server_negotiation.cc:407] Connection header received
0807 02:17:27.956988 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:27.956990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:27.957037 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:27.957108 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:27.958167 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.958672 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.959852 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.960080 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.960203 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:27.962767 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:27.962771 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:27.962773 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:27.962798 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:27.964317 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:27.964806 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:27.964810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:27.964811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:27.964891 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:27.965228 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:27.965233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:27.965234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:27.965426 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:27.965540 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:27.966115 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 02:17:27.966217 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 02:17:27.967625 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:27.955426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:44469)
0807 02:17:27.956046 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:27.956082 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:27.956819 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:27.957280 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:27.957286 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:27.957605 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:27.958042 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:27.958054 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.958879 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.958882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:27.959734 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:27.959746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:27.960248 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:27.960254 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:27.960454 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:27.961068 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:27.961083 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:27.962586 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:27.964436 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:27.964441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:27.964454 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:27.964702 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:27.964982 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:27.964986 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:27.964988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:27.965123 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:27.965538 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:27.965545 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:27.965849 (+ 304us) client_negotiation.cc:769] Sending connection context
0807 02:17:27.966056 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 02:17:27.966399 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":116,"threads_started":1}
I20260807 02:17:27.968843 13798 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38189
I20260807 02:17:27.969105 13798 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:27.969663 13798 heartbeater.cc:511] Master 127.1.126.254:38189 requested a full tablet report, sending...
I20260807 02:17:27.970846 13313 ts_manager.cc:194] Registered new tserver with Master: 253e39223ada44aa9a8d51fb148266fc (127.1.126.194:36991)
I20260807 02:17:27.971658 13313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:44469
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:27.989104 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38189
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:28.102494 13805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:28.102779 13805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:28.102842 13805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:28.106690 13805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:28.106793 13805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:28.106848 13805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:28.112027 13805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:28.112936 13805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:28.113853 13805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:28.123174 13805 server_base.cc:1034] running on GCE node
W20260807 02:17:28.123124 13812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.123124 13818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.123162 13816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:28.123792 13805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:28.124369 13805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:28.125521 13805 hybrid_clock.cc:648] HybridClock initialized: now 1786069048125499 us; error 34 us; skew 500 ppm
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069048, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:28.128340 13805 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:28.129109 13805 webserver.cc:460] Webserver started at http://127.1.126.195:40231/ using document root <none> and password file <none>
I20260807 02:17:28.129652 13805 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:28.129717 13805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:28.129959 13805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:28.131943 13805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "a7bbd52564f04fd2a1a253ee9a0d3008"
format_stamp: "Formatted at 2026-08-07 02:17:28 on dist-test-slave-39l8"
server_key: "7b8a1d6a5a6f217d732b55414df48d6a"
server_key_iv: "559e4bdc3533a0b0a0ea673094cb64cd"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.132507 13805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "a7bbd52564f04fd2a1a253ee9a0d3008"
format_stamp: "Formatted at 2026-08-07 02:17:28 on dist-test-slave-39l8"
server_key: "7b8a1d6a5a6f217d732b55414df48d6a"
server_key_iv: "559e4bdc3533a0b0a0ea673094cb64cd"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.136073 13805 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:28.138393 13827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.139503 13805 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:28.139622 13805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a7bbd52564f04fd2a1a253ee9a0d3008"
format_stamp: "Formatted at 2026-08-07 02:17:28 on dist-test-slave-39l8"
server_key: "7b8a1d6a5a6f217d732b55414df48d6a"
server_key_iv: "559e4bdc3533a0b0a0ea673094cb64cd"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.139724 13805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:28.153545 13805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:28.156612 13805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:28.156757 13805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:28.157341 13805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:28.158115 13805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:28.158166 13805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.158238 13805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:28.158277 13805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.167321 13805 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:35347
I20260807 02:17:28.167351 13989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:35347 every 8 connection(s)
I20260807 02:17:28.168124 13805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:28.175429 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 13805
I20260807 02:17:28.175570 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:28.175848 1531 external_mini_cluster.cc:1428] Setting key 51a0374070450b5759017f6b67dea740
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069048, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:28.181280 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.169921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:35233 (local address 127.1.126.254:38189)
0807 02:17:28.170062 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.170065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.171114 (+ 1049us) server_negotiation.cc:407] Connection header received
0807 02:17:28.171983 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.171987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.172062 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.172173 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.173301 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.173847 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.175054 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.175298 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.175427 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.178300 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:28.178305 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:28.178308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:28.178336 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:28.179630 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:28.180063 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:28.180066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:28.180067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:28.180138 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:28.180427 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:28.180429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:28.180431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:28.180587 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:28.180661 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:28.181065 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 02:17:28.181158 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:17:28.181964 13993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.170275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:35233)
0807 02:17:28.170956 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.170995 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.171782 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.172364 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.172370 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.172708 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.173152 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.173166 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.174002 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.174011 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.174928 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.174938 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.175463 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.175467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.175675 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.176259 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.176279 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.178123 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:28.179733 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:28.179737 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:28.179747 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:28.179977 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:28.180225 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:28.180228 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:28.180229 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:28.180349 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:28.180673 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:28.180677 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:28.180874 (+ 197us) client_negotiation.cc:769] Sending connection context
0807 02:17:28.181018 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 02:17:28.181241 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":125,"threads_started":1}
I20260807 02:17:28.183058 13990 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38189
I20260807 02:17:28.183284 13990 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:28.183739 13990 heartbeater.cc:511] Master 127.1.126.254:38189 requested a full tablet report, sending...
I20260807 02:17:28.184710 13313 ts_manager.cc:194] Registered new tserver with Master: a7bbd52564f04fd2a1a253ee9a0d3008 (127.1.126.195:35347)
I20260807 02:17:28.185249 13313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:35233
I20260807 02:17:28.189965 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab.
Entry for principal oryx/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab.
WARNING: no policy specified for oryx/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab.
Entry for principal oryx/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab.
WARNING: no policy specified for oryx/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab.
Entry for principal oryx/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab.
I20260807 02:17:28.262879 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 13406
I20260807 02:17:28.283317 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 13602
I20260807 02:17:28.291759 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 13805
I20260807 02:17:28.304785 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 13266
I20260807 02:17:28.313578 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38189
--webserver_interface=127.1.126.254
--webserver_port=46793
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:38189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:28.422345 14004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:28.422647 14004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:28.422694 14004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:28.426535 14004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:28.426590 14004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:28.426608 14004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:28.426625 14004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:28.426638 14004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:28.431629 14004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:38189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=46793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:28.432567 14004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:28.433498 14004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:28.441884 14014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.441907 14013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.441934 14017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:28.442040 14004 server_base.cc:1034] running on GCE node
I20260807 02:17:28.442787 14004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:28.443857 14004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:28.445048 14004 hybrid_clock.cc:648] HybridClock initialized: now 1786069048445034 us; error 26 us; skew 500 ppm
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069048, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:28.447711 14004 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:28.448513 14004 webserver.cc:460] Webserver started at http://127.1.126.254:46793/ using document root <none> and password file <none>
I20260807 02:17:28.449054 14004 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:28.449159 14004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:28.452852 14004 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:28.454895 14025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.456032 14004 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:28.456182 14004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "7bd70a2f34bd477fba4dcee0192a821a"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "0306a2049eb6def372dfa451114a9fe3"
server_key_iv: "1de941356ec28c5e4f7881a338be0747"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.456696 14004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:28.468516 14004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:28.471181 14004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:28.471386 14004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:28.478338 14004 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:38189
I20260807 02:17:28.478399 14107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:38189 every 8 connection(s)
I20260807 02:17:28.479411 14004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:28.480086 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 14004
I20260807 02:17:28.480544 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:34027
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:38189
--webserver_port=41537
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:17:28.484364 14108 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:17:28.485936 14108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Bootstrap starting.
I20260807 02:17:28.502657 14108 log.cc:824] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:28.508864 14108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:17:28.509270 14108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Bootstrap complete.
I20260807 02:17:28.513387 14108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:28.513777 14108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd70a2f34bd477fba4dcee0192a821a, State: Initialized, Role: FOLLOWER
I20260807 02:17:28.514302 14108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:28.514417 14108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:28.514504 14108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:28.514626 14108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 1 FOLLOWER]: Advancing to term 2
I20260807 02:17:28.516462 14108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:28.516791 14108 leader_election.cc:302] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bd70a2f34bd477fba4dcee0192a821a; no voters:
I20260807 02:17:28.517112 14108 leader_election.cc:288] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 02:17:28.517196 14114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 02:17:28.517388 14114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [term 2 LEADER]: Becoming Leader. State: Replica: 7bd70a2f34bd477fba4dcee0192a821a, State: Running, Role: LEADER
I20260807 02:17:28.517675 14114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } }
I20260807 02:17:28.518291 14108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:28.518580 14114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bd70a2f34bd477fba4dcee0192a821a. Latest consensus state: current_term: 2 leader_uuid: "7bd70a2f34bd477fba4dcee0192a821a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } } }
I20260807 02:17:28.518728 14114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:28.519093 14116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7bd70a2f34bd477fba4dcee0192a821a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd70a2f34bd477fba4dcee0192a821a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38189 } } }
I20260807 02:17:28.519253 14116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:28.520579 14119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:28.523806 14119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:28.524397 14119 catalog_manager.cc:1259] Loaded cluster ID: 585f69ed854f4d1b94d3a54b292afe84
I20260807 02:17:28.524456 14119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:28.527051 14119 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:28.527685 14119 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7bd70a2f34bd477fba4dcee0192a821a: Loaded TSK: 0
I20260807 02:17:28.528810 14119 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 02:17:28.595311 14112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:28.595518 14112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:28.595554 14112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:28.599339 14112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:28.599385 14112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:28.599460 14112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:28.604445 14112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.193.keytab
--principal=oryx/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:34027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=41537
--tserver_master_addrs=127.1.126.254:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:28.605337 14112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:28.606285 14112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:28.615159 14143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.615175 14145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.615494 14147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:28.615743 14112 server_base.cc:1034] running on GCE node
I20260807 02:17:28.616097 14112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:28.616683 14112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:28.617865 14112 hybrid_clock.cc:648] HybridClock initialized: now 1786069048617845 us; error 37 us; skew 500 ppm
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069048, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:28.620901 14112 init.cc:377] Logged in from keytab as oryx/127.1.126.193@KRBTEST.COM (short username oryx)
I20260807 02:17:28.621740 14112 webserver.cc:460] Webserver started at http://127.1.126.193:41537/ using document root <none> and password file <none>
I20260807 02:17:28.622294 14112 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:28.622402 14112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:28.626335 14112 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 02:17:28.628440 14154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.629650 14112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:28.629742 14112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "c8dec82af86142409770a0acf925aea4"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "243b41bd3ddd20c218738aaace55d213"
server_key_iv: "56a77b40d91afafe538a3d1c37459c80"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.630280 14112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:28.644433 14112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:28.647437 14112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:28.647646 14112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:28.648236 14112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:28.649075 14112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:28.649120 14112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.649183 14112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:28.649212 14112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.659623 14112 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:34027
I20260807 02:17:28.659678 14308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:34027 every 8 connection(s)
I20260807 02:17:28.660645 14112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:28.668005 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 14112
I20260807 02:17:28.668524 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:36991
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:38189
--webserver_port=34905
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:28.673415 14313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.662632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:46605)
0807 02:17:28.663336 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.663375 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.664069 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.664949 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.664955 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.665246 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.665642 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.665654 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.667283 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.667285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.668407 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.668422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.669240 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.669247 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.669449 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.670107 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.670132 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.672761 (+ 2629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":174,"threads_started":1}
W20260807 02:17:28.673924 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:28.662552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:46605 (local address 127.1.126.254:38189)
0807 02:17:28.663030 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.663059 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.663497 (+ 438us) server_negotiation.cc:407] Connection header received
0807 02:17:28.664377 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.664387 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.664636 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.664875 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.665821 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.667166 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.668529 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.669086 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.669198 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.673027 (+ 3829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:46605: BlockingRecv error: recv got EOF from 127.1.126.193:46605 (error 108)
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":155,"threads_started":1}
W20260807 02:17:28.673938 14309 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:38189 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.126.254:38189: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:28.679803 14313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.674336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:40757)
0807 02:17:28.674486 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.674499 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.674573 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.674910 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.674912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.675030 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.675112 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.675117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.676206 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.676208 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.676695 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.676701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.677318 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.677320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.677383 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.677896 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.677907 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.679724 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260807 02:17:28.680048 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:28.674481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:40757 (local address 127.1.126.254:38189)
0807 02:17:28.674633 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.674640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.674657 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:17:28.674728 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.674734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.674809 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.674905 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.675227 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.676099 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.676821 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.677209 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.677332 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.679912 (+ 2580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:40757: BlockingRecv error: recv got EOF from 127.1.126.193:40757 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:28.684791 14313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.680317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:58369)
0807 02:17:28.680398 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.680411 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.680475 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.680681 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.680683 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.680817 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.680873 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.680877 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.681534 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.681538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.682015 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.682022 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.682471 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.682474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.682551 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.682998 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.683009 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.684665 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260807 02:17:28.684871 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:28.680403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:58369 (local address 127.1.126.254:38189)
0807 02:17:28.680501 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.680506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.680520 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:28.680551 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.680553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.680591 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.680668 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.680973 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.681429 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.682127 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.682359 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.682468 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.684770 (+ 2302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:58369: BlockingRecv error: recv got EOF from 127.1.126.193:58369 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260807 02:17:28.684962 14309 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:17:28.778585 14314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:28.778882 14314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:28.778950 14314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:28.782756 14314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:28.782835 14314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:28.782929 14314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:28.787894 14314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.194.keytab
--principal=oryx/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:36991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=34905
--tserver_master_addrs=127.1.126.254:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:28.788858 14314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:28.789857 14314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:17:28.799101 14314 server_base.cc:1034] running on GCE node
W20260807 02:17:28.799067 14326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.799060 14331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.799075 14329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:28.799733 14314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:28.800379 14314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:28.801530 14314 hybrid_clock.cc:648] HybridClock initialized: now 1786069048801501 us; error 43 us; skew 500 ppm
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069048, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:28.804244 14314 init.cc:377] Logged in from keytab as oryx/127.1.126.194@KRBTEST.COM (short username oryx)
I20260807 02:17:28.805069 14314 webserver.cc:460] Webserver started at http://127.1.126.194:34905/ using document root <none> and password file <none>
I20260807 02:17:28.805635 14314 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:28.805732 14314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:28.809289 14314 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 02:17:28.811270 14343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.812506 14314 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 02:17:28.812640 14314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "253e39223ada44aa9a8d51fb148266fc"
format_stamp: "Formatted at 2026-08-07 02:17:27 on dist-test-slave-39l8"
server_key: "703f261c5cd8a6eb7489796b37d5acc9"
server_key_iv: "072c3046ac53b5a9b759ebad46d47d34"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.813155 14314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:28.830138 14314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:28.832890 14314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:28.833139 14314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:28.833716 14314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:28.834637 14314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:28.834684 14314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.834776 14314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:28.834811 14314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.843291 14314 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:36991
I20260807 02:17:28.843362 14512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:36991 every 8 connection(s)
I20260807 02:17:28.844302 14314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:28.846169 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 14314
I20260807 02:17:28.846679 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:35347
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:38189
--webserver_port=40231
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 02:17:28.856210 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:28.846045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:60637 (local address 127.1.126.254:38189)
0807 02:17:28.846177 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.846181 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.847414 (+ 1233us) server_negotiation.cc:407] Connection header received
0807 02:17:28.848302 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.848306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.848370 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.848447 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.849587 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.850123 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.851876 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.852116 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.852219 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.856103 (+ 3884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:60637: BlockingRecv error: recv got EOF from 127.1.126.194:60637 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:17:28.857093 14517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.846525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:60637)
0807 02:17:28.847272 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.847310 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.848078 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.848606 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.848612 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.848936 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.849418 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.849430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.850257 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.850264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.851740 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.851755 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.852286 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.852292 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.852524 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.853107 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.853143 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.855994 (+ 2851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":148,"threads_started":1}
W20260807 02:17:28.857542 14514 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:38189 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.126.254:38189: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:28.862794 14517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.857981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:38797)
0807 02:17:28.858067 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.858081 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.858181 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.858418 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.858421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.858568 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.858647 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.858651 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.859354 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.859358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.859879 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.859887 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.860317 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.860320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.860414 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.860839 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.860850 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.862639 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 02:17:28.862888 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:28.858072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:38797 (local address 127.1.126.254:38189)
0807 02:17:28.858213 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.858218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.858245 (+ 27us) server_negotiation.cc:407] Connection header received
0807 02:17:28.858288 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.858291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.858324 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.858404 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.858784 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.859247 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.860006 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.860209 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.860314 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.862783 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:38797: BlockingRecv error: recv got EOF from 127.1.126.194:38797 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:28.867964 14517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:28.863364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:51419)
0807 02:17:28.863465 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:28.863479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:28.863544 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:28.863730 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:28.863732 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:28.863842 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:28.863900 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.863904 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.864817 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.864819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.865268 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:28.865275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.865764 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.865766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:28.865816 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.866267 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:28.866278 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:28.867886 (+ 1608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 02:17:28.868136 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:28.863451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:51419 (local address 127.1.126.254:38189)
0807 02:17:28.863552 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:28.863555 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:28.863570 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:28.863603 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:28.863606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:28.863641 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:28.863725 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:28.863994 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.864715 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.865363 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:28.865668 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:28.865758 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:28.868028 (+ 2270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:51419: BlockingRecv error: recv got EOF from 127.1.126.194:51419 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 02:17:28.868244 14514 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:17:28.964210 14518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:28.964483 14518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:28.964556 14518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:28.968472 14518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:28.968554 14518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:28.968642 14518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:28.973773 14518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/krb5kdc/oryx_127.1.126.195.keytab
--principal=oryx/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:35347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=40231
--tserver_master_addrs=127.1.126.254:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:28.974819 14518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:28.975857 14518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:28.985248 14528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.985248 14530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:28.985275 14527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:28.985548 14518 server_base.cc:1034] running on GCE node
I20260807 02:17:28.986013 14518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:28.986604 14518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:28.987788 14518 hybrid_clock.cc:648] HybridClock initialized: now 1786069048987768 us; error 34 us; skew 500 ppm
Aug 07 02:17:28 dist-test-slave-39l8 krb5kdc[13244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069048, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:28.990411 14518 init.cc:377] Logged in from keytab as oryx/127.1.126.195@KRBTEST.COM (short username oryx)
I20260807 02:17:28.991262 14518 webserver.cc:460] Webserver started at http://127.1.126.195:40231/ using document root <none> and password file <none>
I20260807 02:17:28.991747 14518 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:28.991819 14518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:28.995561 14518 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:28.997535 14541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:28.998675 14518 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:28.998859 14518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a7bbd52564f04fd2a1a253ee9a0d3008"
format_stamp: "Formatted at 2026-08-07 02:17:28 on dist-test-slave-39l8"
server_key: "7b8a1d6a5a6f217d732b55414df48d6a"
server_key_iv: "559e4bdc3533a0b0a0ea673094cb64cd"
server_key_version: "encryptionkey@0"
I20260807 02:17:28.999342 14518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:29.021651 14518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:29.024484 14518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:29.024669 14518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:29.025226 14518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:29.026016 14518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:29.026062 14518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:29.026134 14518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:29.026170 14518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:29.035033 14518 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:35347
I20260807 02:17:29.035086 14697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:35347 every 8 connection(s)
I20260807 02:17:29.035949 14518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:29.045132 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 14518
W20260807 02:17:29.045846 14311 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:29.037582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:38443 (local address 127.1.126.254:38189)
0807 02:17:29.037728 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:29.037731 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:29.038668 (+ 937us) server_negotiation.cc:407] Connection header received
0807 02:17:29.039491 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:29.039494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:29.039539 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:29.039609 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:29.040656 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.041146 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.042166 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.042385 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.042460 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.045726 (+ 3266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:38443: BlockingRecv error: recv got EOF from 127.1.126.195:38443 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 02:17:29.046520 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:29.037937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:38443)
0807 02:17:29.038532 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:29.038567 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:29.039311 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:29.039760 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:29.039765 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:29.040067 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:29.040529 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.040541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.041246 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.041248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.042064 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.042073 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.042504 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.042507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.042641 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.043239 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:29.043254 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:29.045606 (+ 2352us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":108,"threads_started":1}
W20260807 02:17:29.047046 14698 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:38189 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.126.254:38189: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:29.052139 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:29.047475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:37253)
0807 02:17:29.047583 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:29.047597 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:29.047666 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:29.047933 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:29.047936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:29.048088 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:29.048176 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.048181 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.048868 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.048872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.049436 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.049444 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.049878 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.049881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.049976 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.050400 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:29.050410 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:29.051980 (+ 1570us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 02:17:29.052358 14704 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:29.047546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:37253 (local address 127.1.126.254:38189)
0807 02:17:29.047745 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:29.047749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:29.047767 (+ 18us) server_negotiation.cc:407] Connection header received
0807 02:17:29.047795 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:29.047797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:29.047828 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:29.047919 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:29.048288 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.048760 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.049550 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.049768 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.049875 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.052096 (+ 2221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:37253: BlockingRecv error: recv got EOF from 127.1.126.195:37253 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":64,"threads_started":1}
I20260807 02:17:29.055104 14311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:29.046058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34244 (local address 127.1.126.254:38189)
0807 02:17:29.046188 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:29.046192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:29.046306 (+ 114us) server_negotiation.cc:407] Connection header received
0807 02:17:29.046510 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:29.046513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:29.046553 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:29.046651 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:29.047684 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.048123 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.048958 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.049177 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.049278 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.050762 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:29.050768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:29.050801 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:29.050824 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:29.053053 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:29.053500 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:29.053506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:29.053510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:29.053646 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:29.053922 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:29.053924 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:29.053925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:29.054333 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:29.054536 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:29.054743 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 02:17:29.054970 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:29.057570 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:29.052611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:55347)
0807 02:17:29.052713 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:29.052728 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:29.052812 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:29.053063 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:29.053065 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:29.053188 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:29.053249 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.053254 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.054084 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.054087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.054819 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.054829 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.055391 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.055395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.055473 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.055866 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:29.055877 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:29.057451 (+ 1574us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 02:17:29.057746 14704 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:29.052686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:55347 (local address 127.1.126.254:38189)
0807 02:17:29.052853 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:29.052857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:29.052870 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:29.052906 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:29.052911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:29.052954 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:29.053043 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:29.053361 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.053986 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.054950 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.055272 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.055380 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.057553 (+ 2173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:55347: BlockingRecv error: recv got EOF from 127.1.126.195:55347 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260807 02:17:29.057842 14698 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:29.690990 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:29.685622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:46549)
0807 02:17:29.685874 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:29.685892 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:29.685983 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:29.686220 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:29.686222 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:29.686390 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:29.686499 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.686505 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.687274 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.687281 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.687966 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.687976 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.688461 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.688465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.688562 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.689015 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:29.689026 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:29.690878 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":80,"threads_started":1}
W20260807 02:17:29.691167 14707 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:29.685655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:46549 (local address 127.1.126.254:38189)
0807 02:17:29.685944 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:29.685948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:29.685961 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:29.686061 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:29.686063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:29.686107 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:29.686182 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:29.686590 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.687140 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.688094 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.688340 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.688452 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.691031 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:46549: BlockingRecv error: recv got EOF from 127.1.126.193:46549 (error 108)
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":132,"threads_started":1}
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:29 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:29.873996 14708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:29.868806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:58781)
0807 02:17:29.869066 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:29.869079 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:29.869167 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:29.869402 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:29.869404 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:29.869579 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:29.869714 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.869720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.870404 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.870406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.870975 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:29.870984 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.871402 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.871404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:29.871472 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.872070 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:29.872082 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:29.873868 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":69,"threads_started":1}
W20260807 02:17:29.874251 14707 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:29.868898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58781 (local address 127.1.126.254:38189)
0807 02:17:29.869102 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:29.869106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:29.869121 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:29.869254 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:29.869256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:29.869299 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:29.869365 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:29.869810 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.870314 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.871101 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:29.871304 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:29.871382 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:29.874115 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:58781: BlockingRecv error: recv got EOF from 127.1.126.194:58781 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 02:17:30 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:30 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:30.063674 14709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:30.058412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:45883)
0807 02:17:30.058692 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:30.058743 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:30.058853 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:30.059096 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:30.059099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:30.059281 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:30.059419 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:30.059425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.060146 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.060149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:30.060730 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:30.060738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.061191 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.061195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:30.061299 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:30.061750 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:30.061761 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:30.063557 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":67,"threads_started":1}
W20260807 02:17:30.063802 14707 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:30.058521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:45883 (local address 127.1.126.254:38189)
0807 02:17:30.058699 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:30.058725 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:30.058819 (+ 94us) server_negotiation.cc:407] Connection header received
0807 02:17:30.058929 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:30.058931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:30.058975 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:30.059061 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:30.059511 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.060046 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.060853 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.061066 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.061144 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:30.063685 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:45883: BlockingRecv error: recv got EOF from 127.1.126.195:45883 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 02:17:30 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:30 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:30.697193 14710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:30.691932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:34151)
0807 02:17:30.692270 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:30.692286 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:30.692385 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:30.692676 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:30.692679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:30.692851 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:30.692950 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:30.692955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.693673 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.693676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:30.694257 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:30.694265 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.694670 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.694673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:30.694807 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:30.695292 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:30.695304 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:30.697068 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":103,"threads_started":1}
W20260807 02:17:30.697276 14712 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:30.692059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:34151 (local address 127.1.126.254:38189)
0807 02:17:30.692343 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:30.692347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:30.692360 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:30.692473 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:30.692476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:30.692524 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:30.692599 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:30.693055 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.693575 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.694356 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.694572 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.694646 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:30.697172 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:34151: BlockingRecv error: recv got EOF from 127.1.126.193:34151 (error 108)
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":85,"threads_started":1}
Aug 07 02:17:30 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:30 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:30.880213 14713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:30.874746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:40335)
0807 02:17:30.875016 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:30.875029 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:30.875169 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:30.875442 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:30.875445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:30.875657 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:30.875750 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:30.875756 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.876527 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.876532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:30.877085 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:30.877093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.877558 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.877561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:30.877668 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:30.878239 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:30.878250 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:30.880084 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":77,"threads_started":1}
W20260807 02:17:30.880391 14712 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:30.874784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:40335 (local address 127.1.126.254:38189)
0807 02:17:30.874925 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:30.874930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:30.875105 (+ 175us) server_negotiation.cc:407] Connection header received
0807 02:17:30.875273 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:30.875277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:30.875330 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:30.875417 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:30.875872 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.876392 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.877218 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:30.877441 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:30.877552 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:30.880237 (+ 2685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:40335: BlockingRecv error: recv got EOF from 127.1.126.194:40335 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 02:17:31 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:31 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:31.075076 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:31.064579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:38819)
0807 02:17:31.064862 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:31.064875 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:31.064972 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:31.065221 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:31.065224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:31.065400 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:31.065496 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:31.065502 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.066194 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.066196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:31.066775 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:31.066786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.067181 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.067184 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:31.067243 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:31.072917 (+ 5674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:31.072931 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:31.074927 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":109,"threads_started":1}
W20260807 02:17:31.075271 14712 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:31.064732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:38819 (local address 127.1.126.254:38189)
0807 02:17:31.064862 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:31.064866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:31.064950 (+ 84us) server_negotiation.cc:407] Connection header received
0807 02:17:31.065055 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:31.065057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:31.065103 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:31.065172 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:31.065593 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.066097 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.066876 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.067079 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.067156 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:31.075099 (+ 7943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:38819: BlockingRecv error: recv got EOF from 127.1.126.195:38819 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 02:17:31 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:31 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:31.703473 14715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:31.698168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:36811)
0807 02:17:31.698474 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:31.698488 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:31.698574 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:31.698863 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:31.698867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:31.699100 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:31.699205 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:31.699211 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.699908 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.699910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:31.700458 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:31.700465 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.700865 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.700868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:31.700949 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:31.701476 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:31.701487 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:31.703353 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":86,"threads_started":1}
W20260807 02:17:31.703693 14716 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:31.698215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:36811 (local address 127.1.126.254:38189)
0807 02:17:31.698558 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:31.698561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:31.698574 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:31.698664 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:31.698666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:31.698725 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:31.698799 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:31.699311 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.699817 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.700555 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.700770 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.700842 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:31.703476 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:36811: BlockingRecv error: recv got EOF from 127.1.126.193:36811 (error 108)
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":127,"threads_started":1}
Aug 07 02:17:31 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:31 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:31.886431 14717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:31.880942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:53213)
0807 02:17:31.881231 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:31.881245 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:31.881340 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:31.881575 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:31.881577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:31.881755 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:31.881850 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:31.881855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.882603 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.882606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:31.883283 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:31.883295 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.883733 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.883736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:31.883801 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:31.884367 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:31.884379 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:31.886300 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":111,"threads_started":1}
W20260807 02:17:31.886560 14716 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:31.881031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:53213 (local address 127.1.126.254:38189)
0807 02:17:31.881174 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:31.881178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:31.881309 (+ 131us) server_negotiation.cc:407] Connection header received
0807 02:17:31.881416 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:31.881419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:31.881464 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:31.881537 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:31.881943 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.882451 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.883399 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:31.883619 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:31.883698 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:31.886441 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:53213: BlockingRecv error: recv got EOF from 127.1.126.194:53213 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 02:17:32 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:32 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:32.080878 14718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:32.075806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:35943)
0807 02:17:32.076093 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:32.076108 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:32.076213 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:32.076437 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:32.076439 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:32.076626 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:32.076725 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:32.076730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.077427 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.077429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:32.077990 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:32.077997 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.078391 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.078393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:32.078453 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:32.078963 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:32.078974 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:32.080752 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":123,"threads_started":1}
W20260807 02:17:32.081012 14716 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:32.075894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:35943 (local address 127.1.126.254:38189)
0807 02:17:32.076032 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:32.076037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:32.076191 (+ 154us) server_negotiation.cc:407] Connection header received
0807 02:17:32.076280 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:32.076282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:32.076329 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:32.076400 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:32.076823 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.077335 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.078085 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.078299 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.078372 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:32.080884 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:35943: BlockingRecv error: recv got EOF from 127.1.126.195:35943 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 02:17:32 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:32 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:32.709461 14719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:32.704325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:58145)
0807 02:17:32.704613 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:32.704632 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:32.704729 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:32.704949 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:32.704951 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:32.705139 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:32.705237 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:32.705242 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.705952 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.705954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:32.706502 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:32.706509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.706934 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.706937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:32.707004 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:32.707508 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:32.707519 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:32.709348 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":85,"threads_started":1}
W20260807 02:17:32.709619 14721 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:32.704464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:58145 (local address 127.1.126.254:38189)
0807 02:17:32.704745 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:32.704749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:32.704762 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:32.704796 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:32.704799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:32.704840 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:32.704916 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:32.705343 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.705860 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.706602 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.706838 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.706907 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:32.709483 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:58145: BlockingRecv error: recv got EOF from 127.1.126.193:58145 (error 108)
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":132,"threads_started":1}
Aug 07 02:17:32 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:32 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:32.892493 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:32.887387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:40497)
0807 02:17:32.887644 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:32.887657 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:32.887763 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:32.887972 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:32.887974 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:32.888148 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:32.888246 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:32.888251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.888935 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.888937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:32.889450 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:32.889458 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.889852 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.889855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:32.889915 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:32.890461 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:32.890472 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:32.892325 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":72,"threads_started":1}
W20260807 02:17:32.892567 14721 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:32.887472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:40497 (local address 127.1.126.254:38189)
0807 02:17:32.887657 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:32.887661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:32.887719 (+ 58us) server_negotiation.cc:407] Connection header received
0807 02:17:32.887829 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:32.887831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:32.887872 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:32.887937 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:32.888347 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.888846 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.889548 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:32.889758 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:32.889832 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:32.892452 (+ 2620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:40497: BlockingRecv error: recv got EOF from 127.1.126.194:40497 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 02:17:33 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:33 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:33.087198 14724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:33.081754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:56693)
0807 02:17:33.082057 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:33.082072 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:33.082212 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:33.082487 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:33.082490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:33.082768 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:33.082861 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:33.082867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.083611 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.083617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:33.084175 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:33.084183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.084629 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.084633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:33.084711 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:33.085249 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:33.085263 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:33.087004 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":107,"threads_started":1}
W20260807 02:17:33.087245 14721 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:33.081863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:56693 (local address 127.1.126.254:38189)
0807 02:17:33.082016 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:33.082021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:33.082147 (+ 126us) server_negotiation.cc:407] Connection header received
0807 02:17:33.082313 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:33.082316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:33.082372 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:33.082467 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:33.082980 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.083501 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.084294 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.084520 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.084628 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:33.087140 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:56693: BlockingRecv error: recv got EOF from 127.1.126.195:56693 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 02:17:33 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:33 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:33.716153 14726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:33.710320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:42665)
0807 02:17:33.710660 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:33.710679 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:33.710846 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:33.711287 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:33.711290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:33.711486 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:33.711646 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:33.711658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.712512 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.712515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:33.713150 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:33.713159 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.713569 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.713572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:33.713637 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:33.714115 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:33.714126 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:33.716023 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":96,"threads_started":1}
W20260807 02:17:33.716322 14727 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:33.710473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:42665 (local address 127.1.126.254:38189)
0807 02:17:33.710819 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:33.710823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:33.710835 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:17:33.711059 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:33.711062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:33.711121 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:33.711220 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:33.711780 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.712404 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.713253 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.713467 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.713540 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:33.716156 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:42665: BlockingRecv error: recv got EOF from 127.1.126.193:42665 (error 108)
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":138,"threads_started":1}
Aug 07 02:17:33 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:33 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:33.898994 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:33.893368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:60227)
0807 02:17:33.893689 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:33.893704 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:33.893820 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:33.894146 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:33.894149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:33.894437 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:33.894577 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:33.894585 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.895459 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.895461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:33.896006 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:33.896014 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.896431 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.896435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:33.896520 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:33.897064 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:33.897076 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:33.898822 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":98,"threads_started":1}
W20260807 02:17:33.899050 14727 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:33.893573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:60227 (local address 127.1.126.254:38189)
0807 02:17:33.893756 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:33.893763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:33.893779 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:17:33.893923 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:33.893925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:33.893998 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:33.894084 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:33.894760 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.895348 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.896114 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:33.896320 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:33.896425 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:33.898940 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:60227: BlockingRecv error: recv got EOF from 127.1.126.194:60227 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 02:17:34 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:34 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:34.093353 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:34.087998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:45377)
0807 02:17:34.088317 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:34.088353 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:34.088489 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:34.088783 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:34.088785 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:34.089060 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:34.089182 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:34.089190 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.089949 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.089952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:34.090523 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:34.090530 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.090927 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.090929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:34.090991 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:34.091457 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:34.091467 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:34.093238 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":92,"threads_started":1}
W20260807 02:17:34.093485 14727 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:34.088122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:45377 (local address 127.1.126.254:38189)
0807 02:17:34.088278 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:34.088283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:34.088451 (+ 168us) server_negotiation.cc:407] Connection header received
0807 02:17:34.088592 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:34.088598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:34.088654 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:34.088742 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:34.089303 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.089853 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.090615 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.090835 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.090910 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:34.093363 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:45377: BlockingRecv error: recv got EOF from 127.1.126.195:45377 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 02:17:34 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:34 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:34.723007 14732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:34.716967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:40653)
0807 02:17:34.717300 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:34.717319 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:34.717435 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:34.717752 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:34.717754 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:34.718039 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:34.718176 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:34.718185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.719140 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.719143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:34.719921 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:34.719931 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.720377 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.720380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:34.720443 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:34.720969 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:34.720980 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:34.722838 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":85,"threads_started":1}
W20260807 02:17:34.723083 14733 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:34.717082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:40653 (local address 127.1.126.254:38189)
0807 02:17:34.717366 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:34.717371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:34.717384 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:34.717540 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:34.717546 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:34.717605 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:34.717707 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:34.718344 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.719040 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.720041 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.720267 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.720361 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:34.722958 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:40653: BlockingRecv error: recv got EOF from 127.1.126.193:40653 (error 108)
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":62,"threads_started":1}
Aug 07 02:17:34 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:34 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:34.905177 14734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:34.899863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:51105)
0807 02:17:34.900143 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:34.900156 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:34.900289 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:34.900569 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:34.900571 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:34.900830 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:34.900928 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:34.900933 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.901624 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.901627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:34.902203 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:34.902212 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.902629 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.902634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:34.902760 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:34.903300 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:34.903311 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:34.905063 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":86,"threads_started":1}
W20260807 02:17:34.905346 14733 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:34.899902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:51105 (local address 127.1.126.254:38189)
0807 02:17:34.900075 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:34.900080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:34.900233 (+ 153us) server_negotiation.cc:407] Connection header received
0807 02:17:34.900397 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:34.900400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:34.900453 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:34.900543 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:34.901028 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.901526 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.902300 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:34.902505 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:34.902627 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:34.905193 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:51105: BlockingRecv error: recv got EOF from 127.1.126.194:51105 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 02:17:35 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:35 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:35.099917 14737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:35.094200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:34433)
0807 02:17:35.094510 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:35.094523 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:35.094657 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:35.095014 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:35.095017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:35.095238 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:35.095330 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:35.095336 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.096093 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.096098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:35.096676 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:35.096684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.097163 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.097166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:35.097253 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:35.097759 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:35.097804 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:35.099745 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":85,"threads_started":1}
W20260807 02:17:35.099974 14733 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:35.094283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:34433 (local address 127.1.126.254:38189)
0807 02:17:35.094422 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:35.094427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:35.094598 (+ 171us) server_negotiation.cc:407] Connection header received
0807 02:17:35.094822 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:35.094826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:35.094882 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:35.094977 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:35.095452 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.095976 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.096806 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.097032 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.097158 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:35.099865 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:34433: BlockingRecv error: recv got EOF from 127.1.126.195:34433 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 02:17:35 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:35 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:35.728935 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:35.723827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:37249)
0807 02:17:35.724225 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:35.724239 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:35.724337 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:35.724567 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:35.724569 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:35.724750 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:35.724842 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:35.724847 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.725529 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.725531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:35.726050 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:35.726057 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.726487 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.726490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:35.726550 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:35.727047 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:35.727059 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:35.728823 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":92,"threads_started":1}
W20260807 02:17:35.729086 14740 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:35.723887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:37249 (local address 127.1.126.254:38189)
0807 02:17:35.724185 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:35.724189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:35.724308 (+ 119us) server_negotiation.cc:407] Connection header received
0807 02:17:35.724414 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:35.724416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:35.724460 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:35.724535 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:35.724939 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.725440 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.726180 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.726397 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.726465 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:35.728953 (+ 2488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:37249: BlockingRecv error: recv got EOF from 127.1.126.193:37249 (error 108)
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":88,"threads_started":1}
Aug 07 02:17:35 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:35 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:35.911473 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:35.906031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:51167)
0807 02:17:35.906388 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:35.906401 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:35.906498 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:35.906809 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:35.906812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:35.906991 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:35.907087 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:35.907093 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.907790 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.907793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:35.908371 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:35.908378 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.908828 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.908830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:35.908888 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:35.909467 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:35.909479 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:35.911358 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":130,"threads_started":1}
W20260807 02:17:35.911614 14740 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:35.906084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:51167 (local address 127.1.126.254:38189)
0807 02:17:35.906225 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:35.906229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:35.906472 (+ 243us) server_negotiation.cc:407] Connection header received
0807 02:17:35.906618 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:35.906621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:35.906664 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:35.906786 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:35.907192 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.907699 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.908496 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:35.908717 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:35.908812 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:35.911496 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:51167: BlockingRecv error: recv got EOF from 127.1.126.194:51167 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 02:17:36 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:36 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:36.109604 14743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:36.100850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:60763)
0807 02:17:36.101160 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:36.101199 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:36.101297 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:36.101540 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:36.101543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:36.101720 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:36.101815 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:36.101820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.102596 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.102599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:36.103173 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:36.103181 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.103639 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.103642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:36.103704 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:36.107623 (+ 3919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:36.107635 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:36.109489 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":87,"threads_started":1}
W20260807 02:17:36.109747 14740 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:36.100922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:60763 (local address 127.1.126.254:38189)
0807 02:17:36.101064 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:36.101069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:36.101271 (+ 202us) server_negotiation.cc:407] Connection header received
0807 02:17:36.101361 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:36.101363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:36.101427 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:36.101493 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:36.101917 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.102494 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.103301 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.103540 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.103627 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:36.109621 (+ 5994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:60763: BlockingRecv error: recv got EOF from 127.1.126.195:60763 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 02:17:36 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:36 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:36.735608 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:36.729892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:57953)
0807 02:17:36.730361 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:36.730378 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:36.730491 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:36.730834 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:36.730840 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:36.731023 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:36.731121 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:36.731126 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.731837 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.731840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:36.732387 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:36.732394 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.732798 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.732801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:36.732859 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:36.733406 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:36.733417 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:36.735441 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":79,"threads_started":1}
W20260807 02:17:36.735679 14745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:36.730002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:57953 (local address 127.1.126.254:38189)
0807 02:17:36.730281 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:36.730285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:36.730461 (+ 176us) server_negotiation.cc:407] Connection header received
0807 02:17:36.730622 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:36.730627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:36.730686 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:36.730813 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:36.731224 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.731745 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.732484 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.732701 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.732776 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:36.735558 (+ 2782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:57953: BlockingRecv error: recv got EOF from 127.1.126.193:57953 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":81,"threads_started":1}
Aug 07 02:17:36 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:36 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:36.918021 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:36.912440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:46591)
0807 02:17:36.912719 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:36.912733 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:36.912830 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:36.913054 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:36.913056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:36.913239 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:36.913332 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:36.913337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.914369 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.914374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:36.915009 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:36.915019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.915455 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.915457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:36.915515 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:36.916017 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:36.916028 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:36.917912 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":98,"threads_started":1}
W20260807 02:17:36.918156 14745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:36.912522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:46591 (local address 127.1.126.254:38189)
0807 02:17:36.912678 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:36.912682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:36.912782 (+ 100us) server_negotiation.cc:407] Connection header received
0807 02:17:36.912896 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:36.912899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:36.912945 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:36.913015 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:36.913426 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.914263 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.915110 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:36.915343 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:36.915440 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:36.918040 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:46591: BlockingRecv error: recv got EOF from 127.1.126.194:46591 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 02:17:37 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:37 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:37.116703 14749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:37.110519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:57863)
0807 02:17:37.110873 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:37.110895 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:37.111055 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:37.111409 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:37.111413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:37.111651 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:37.111819 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:37.111827 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.112921 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.112924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:37.113468 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:37.113475 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.113885 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.113888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:37.113951 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:37.114450 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:37.114461 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:37.116483 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":147,"threads_started":1}
W20260807 02:17:37.116740 14745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:37.110638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:57863 (local address 127.1.126.254:38189)
0807 02:17:37.110846 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:37.110851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:37.110982 (+ 131us) server_negotiation.cc:407] Connection header received
0807 02:17:37.111170 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:37.111173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:37.111256 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:37.111342 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:37.111946 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.112817 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.113574 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.113785 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.113864 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:37.116610 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:57863: BlockingRecv error: recv got EOF from 127.1.126.195:57863 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 07 02:17:37 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:37 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:37.742843 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:37.736414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:59627)
0807 02:17:37.736712 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:37.736726 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:37.736810 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:37.737113 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:37.737115 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:37.737298 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:37.737397 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:37.737402 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.738492 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.738500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:37.739141 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:37.739150 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.739806 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.739809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:37.739871 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:37.740499 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:37.740511 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:37.742618 (+ 2107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":106,"threads_started":1}
W20260807 02:17:37.742956 14754 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:37.736486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:59627 (local address 127.1.126.254:38189)
0807 02:17:37.736747 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:37.736752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:37.736788 (+ 36us) server_negotiation.cc:407] Connection header received
0807 02:17:37.736914 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:37.736917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:37.736972 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:37.737063 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:37.737513 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.738367 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.739260 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.739684 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.739806 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:37.742811 (+ 3005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:59627: BlockingRecv error: recv got EOF from 127.1.126.193:59627 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":94,"threads_started":1}
Aug 07 02:17:37 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:37 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:37.924872 14755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:37.918965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:44641)
0807 02:17:37.919299 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:37.919313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:37.919454 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:37.919750 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:37.919753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:37.919963 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:37.920087 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:37.920094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.920883 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.920888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:37.921449 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:37.921457 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.921920 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.921924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:37.922006 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:37.922560 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:37.922578 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:37.924742 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":96,"threads_started":1}
W20260807 02:17:37.925199 14754 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:37.919035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:44641 (local address 127.1.126.254:38189)
0807 02:17:37.919206 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:37.919211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:37.919401 (+ 190us) server_negotiation.cc:407] Connection header received
0807 02:17:37.919590 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:37.919593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:37.919641 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:37.919728 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:37.920208 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.920770 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.921566 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:37.921798 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:37.921907 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:37.924909 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:44641: BlockingRecv error: recv got EOF from 127.1.126.194:44641 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 02:17:38 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:38 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:38.123694 14756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:38.117505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:56949)
0807 02:17:38.117850 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:38.117885 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:38.118010 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:38.118282 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:38.118285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:38.118505 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:38.118601 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:38.118606 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.119852 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.119856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:38.120534 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:38.120544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.120994 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.120997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:38.121061 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:38.121544 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:38.121555 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:38.123577 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":123,"threads_started":1}
W20260807 02:17:38.123835 14754 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:38.117662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:56949 (local address 127.1.126.254:38189)
0807 02:17:38.117825 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:38.117830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:38.117941 (+ 111us) server_negotiation.cc:407] Connection header received
0807 02:17:38.118102 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:38.118105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:38.118169 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:38.118260 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:38.118763 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.119590 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.120669 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.120888 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.120974 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:38.123716 (+ 2742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:56949: BlockingRecv error: recv got EOF from 127.1.126.195:56949 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 02:17:38 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:38 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:38.749126 14757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:38.743716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:55979)
0807 02:17:38.744022 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:38.744036 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:38.744123 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:38.744385 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:38.744387 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:38.744580 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:38.744679 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:38.744684 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.745463 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.745466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:38.746014 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:38.746049 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.746476 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.746478 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:38.746540 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:38.747128 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:38.747141 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:38.748988 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":117,"threads_started":1}
W20260807 02:17:38.749429 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:38.743861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:55979 (local address 127.1.126.254:38189)
0807 02:17:38.744102 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:38.744105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:38.744119 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:38.744206 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:38.744208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:38.744253 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:38.744332 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:38.744806 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.745361 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.746149 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.746375 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.746451 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:38.749139 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:55979: BlockingRecv error: recv got EOF from 127.1.126.193:55979 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":89,"threads_started":1}
Aug 07 02:17:38 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:38 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:38.931325 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:38.925671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:53481)
0807 02:17:38.925986 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:38.926008 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:38.926138 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:38.926431 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:38.926435 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:38.926651 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:38.926771 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:38.926778 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.927552 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.927558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:38.928111 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:38.928118 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.928590 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.928594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:38.928673 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:38.929216 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:38.929228 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:38.931146 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":111,"threads_started":1}
W20260807 02:17:38.931388 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:38.925772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:53481 (local address 127.1.126.254:38189)
0807 02:17:38.925948 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:38.925953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:38.926090 (+ 137us) server_negotiation.cc:407] Connection header received
0807 02:17:38.926259 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:38.926263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:38.926317 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:38.926406 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:38.926893 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.927435 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.928239 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:38.928473 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:38.928586 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:38.931277 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:53481: BlockingRecv error: recv got EOF from 127.1.126.194:53481 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 02:17:39 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:39 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:39.130151 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:39.124477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:46021)
0807 02:17:39.124784 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:39.124815 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:39.124917 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:39.125212 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:39.125215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:39.125425 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:39.125517 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:39.125522 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.126288 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.126293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:39.126893 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:39.126902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.127378 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.127381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:39.127471 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:39.127959 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:39.127969 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:39.130021 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":97,"threads_started":1}
W20260807 02:17:39.130440 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:39.124715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:46021 (local address 127.1.126.254:38189)
0807 02:17:39.124884 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:39.124888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:39.124903 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:17:39.125036 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:39.125040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:39.125094 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:39.125191 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:39.125656 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.126165 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.127021 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.127261 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.127364 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:39.130149 (+ 2785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:46021: BlockingRecv error: recv got EOF from 127.1.126.195:46021 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 02:17:39 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:39 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:39.755307 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:39.749974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:51383)
0807 02:17:39.750259 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:39.750272 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:39.750361 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:39.750607 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:39.750609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:39.750802 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:39.750896 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:39.750901 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.751616 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.751618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:39.752182 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:39.752190 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.752591 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.752593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:39.752652 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:39.753207 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:39.753219 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:39.755153 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":91,"threads_started":1}
W20260807 02:17:39.755447 14764 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:39.750062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:51383 (local address 127.1.126.254:38189)
0807 02:17:39.750322 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:39.750326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:39.750339 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:39.750449 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:39.750451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:39.750495 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:39.750569 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:39.750993 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.751529 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.752283 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.752498 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.752571 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:39.755317 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:51383: BlockingRecv error: recv got EOF from 127.1.126.193:51383 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":61,"threads_started":1}
Aug 07 02:17:39 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:39 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:39.937986 14765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:39.932151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:45697)
0807 02:17:39.932477 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:39.932497 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:39.932657 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:39.932949 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:39.932952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:39.933173 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:39.933273 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:39.933278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.934140 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.934145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:39.934809 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:39.934820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.935306 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.935310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:39.935406 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:39.935885 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:39.935897 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:39.937818 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":85,"threads_started":1}
W20260807 02:17:39.938299 14764 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:39.932264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:45697 (local address 127.1.126.254:38189)
0807 02:17:39.932443 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:39.932448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:39.932586 (+ 138us) server_negotiation.cc:407] Connection header received
0807 02:17:39.932770 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:39.932773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:39.932832 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:39.932920 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:39.933395 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.934025 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.934934 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:39.935184 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:39.935303 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:39.938064 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:45697: BlockingRecv error: recv got EOF from 127.1.126.194:45697 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 02:17:40 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:40 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:40.136723 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:40.130976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:35113)
0807 02:17:40.131250 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:40.131264 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:40.131363 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:40.131587 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:40.131589 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:40.131769 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:40.131869 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:40.131874 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.132629 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.132631 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:40.133252 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:40.133261 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.133694 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.133696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:40.133755 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:40.134295 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:40.134306 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:40.136535 (+ 2229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":102,"threads_started":1}
W20260807 02:17:40.136752 14764 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:40.131009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:35113 (local address 127.1.126.254:38189)
0807 02:17:40.131163 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:40.131168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:40.131333 (+ 165us) server_negotiation.cc:407] Connection header received
0807 02:17:40.131440 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:40.131442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:40.131488 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:40.131552 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:40.131963 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.132530 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.133381 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.133596 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.133676 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:40.136648 (+ 2972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:35113: BlockingRecv error: recv got EOF from 127.1.126.195:35113 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 02:17:40 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:40 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:40.761641 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:40.756121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:49723)
0807 02:17:40.756402 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:40.756415 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:40.756514 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:40.756815 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:40.756817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:40.756999 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:40.757096 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:40.757100 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.757915 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.757918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:40.758460 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:40.758467 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.758924 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.758926 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:40.758990 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:40.759471 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:40.759482 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:40.761523 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":94,"threads_started":1}
W20260807 02:17:40.761835 14768 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:40.756178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:49723 (local address 127.1.126.254:38189)
0807 02:17:40.756428 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:40.756432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:40.756487 (+ 55us) server_negotiation.cc:407] Connection header received
0807 02:17:40.756641 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:40.756644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:40.756694 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:40.756779 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:40.757253 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.757806 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.758573 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.758819 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.758902 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:40.761651 (+ 2749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:49723: BlockingRecv error: recv got EOF from 127.1.126.193:49723 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":64,"threads_started":1}
Aug 07 02:17:40 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:40 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:40.944291 14769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:40.938759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:58855)
0807 02:17:40.939114 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:40.939129 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:40.939274 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:40.939561 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:40.939564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:40.939783 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:40.939881 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:40.939887 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.940656 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.940662 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:40.941222 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:40.941230 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.941698 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.941702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:40.941784 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:40.942282 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:40.942294 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:40.944122 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":84,"threads_started":1}
W20260807 02:17:40.944367 14768 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:40.938783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58855 (local address 127.1.126.254:38189)
0807 02:17:40.938922 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:40.938926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:40.939222 (+ 296us) server_negotiation.cc:407] Connection header received
0807 02:17:40.939387 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:40.939392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:40.939447 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:40.939533 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:40.940004 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.940542 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.941346 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:40.941581 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:40.941700 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:40.944256 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:58855: BlockingRecv error: recv got EOF from 127.1.126.194:58855 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 02:17:41 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:41 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:41.146474 14770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:41.137677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:59619)
0807 02:17:41.137978 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:41.137998 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:41.138096 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:41.138337 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:41.138338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:41.138517 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:41.138615 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:41.138621 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.139361 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.139363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:41.139900 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:41.139908 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.140325 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.140327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:41.140405 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:41.144155 (+ 3750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:41.144167 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:41.146315 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":133,"threads_started":1}
W20260807 02:17:41.146627 14768 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:41.137768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:59619 (local address 127.1.126.254:38189)
0807 02:17:41.137897 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:41.137901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:41.138065 (+ 164us) server_negotiation.cc:407] Connection header received
0807 02:17:41.138181 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:41.138184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:41.138229 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:41.138296 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:41.138742 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.139265 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.139998 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.140213 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.140298 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:41.146491 (+ 6193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:59619: BlockingRecv error: recv got EOF from 127.1.126.195:59619 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 02:17:41 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:41 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:41.768314 14771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:41.762485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:57275)
0807 02:17:41.762853 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:41.762867 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:41.762973 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:41.763238 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:41.763240 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:41.763433 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:41.763531 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:41.763536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.764286 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.764289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:41.764855 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:41.764862 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.765459 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.765464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:41.765560 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:41.766287 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:41.766299 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:41.768181 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":109,"threads_started":1}
W20260807 02:17:41.768465 14773 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:41.762558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:57275 (local address 127.1.126.254:38189)
0807 02:17:41.762868 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:41.762871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:41.762943 (+ 72us) server_negotiation.cc:407] Connection header received
0807 02:17:41.763063 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:41.763066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:41.763111 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:41.763188 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:41.763639 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.764191 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.764978 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.765303 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.765451 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:41.768332 (+ 2881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:57275: BlockingRecv error: recv got EOF from 127.1.126.193:57275 (error 108)
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":92,"threads_started":1}
Aug 07 02:17:41 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:41 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:41.950357 14774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:41.945152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:47419)
0807 02:17:41.945414 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:41.945428 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:41.945516 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:41.945775 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:41.945777 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:41.945961 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:41.946054 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:41.946059 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.946827 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.946829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:41.947373 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:41.947382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.947803 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.947805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:41.947861 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:41.948322 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:41.948332 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:41.950189 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":93,"threads_started":1}
W20260807 02:17:41.950482 14773 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:41.945309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:47419 (local address 127.1.126.254:38189)
0807 02:17:41.945450 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:41.945454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:41.945468 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:41.945618 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:41.945620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:41.945666 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:41.945736 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:41.946151 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.946672 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.947481 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:41.947700 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:41.947783 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:41.950346 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:47419: BlockingRecv error: recv got EOF from 127.1.126.194:47419 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 02:17:42 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:42 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:42.152689 14776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:42.147323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:54701)
0807 02:17:42.147609 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:42.147622 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:42.147720 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:42.147970 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:42.147973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:42.148163 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:42.148261 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:42.148267 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.149008 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.149013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:42.149586 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:42.149595 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.150015 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.150019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:42.150086 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:42.150567 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:42.150578 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:42.152574 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":87,"threads_started":1}
W20260807 02:17:42.152837 14773 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:42.147416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:54701 (local address 127.1.126.254:38189)
0807 02:17:42.147600 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:42.147604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:42.147696 (+ 92us) server_negotiation.cc:407] Connection header received
0807 02:17:42.147799 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:42.147801 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:42.147847 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:42.147931 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:42.148369 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.148881 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.149694 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.149917 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.149989 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:42.152713 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:54701: BlockingRecv error: recv got EOF from 127.1.126.195:54701 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 02:17:42 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:42 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:42.774963 14777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:42.769134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:39015)
0807 02:17:42.769446 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:42.769461 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:42.769570 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:42.769838 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:42.769840 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:42.770045 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:42.770148 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:42.770154 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.770971 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.770974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:42.771605 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:42.771614 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.772159 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.772164 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:42.772295 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:42.772899 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:42.772911 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:42.774847 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":111,"threads_started":1}
W20260807 02:17:42.775134 14779 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:42.769227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:39015 (local address 127.1.126.254:38189)
0807 02:17:42.769521 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:42.769525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:42.769537 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:17:42.769662 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:42.769664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:42.769710 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:42.769792 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:42.770253 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.770854 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.771711 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.771934 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.772032 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:42.774988 (+ 2956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:39015: BlockingRecv error: recv got EOF from 127.1.126.193:39015 (error 108)
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":86,"threads_started":1}
Aug 07 02:17:42 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:42 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:42.956408 14782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:42.951159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:53803)
0807 02:17:42.951466 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:42.951480 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:42.951576 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:42.951823 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:42.951825 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:42.952003 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:42.952128 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:42.952133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.952874 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.952876 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:42.953418 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:42.953426 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.953842 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.953844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:42.953904 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:42.954454 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:42.954466 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:42.956293 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":126,"threads_started":1}
W20260807 02:17:42.956545 14779 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:42.951233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:53803 (local address 127.1.126.254:38189)
0807 02:17:42.951390 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:42.951395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:42.951551 (+ 156us) server_negotiation.cc:407] Connection header received
0807 02:17:42.951659 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:42.951662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:42.951719 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:42.951785 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:42.952245 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.952780 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.953537 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:42.953747 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:42.953822 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:42.956426 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:53803: BlockingRecv error: recv got EOF from 127.1.126.194:53803 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 02:17:43 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:43 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.195@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:43.159384 14783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:43.153673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.195:53221)
0807 02:17:43.153993 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:43.154009 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:43.154111 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:43.154347 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:43.154349 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:43.154534 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:43.154632 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:43.154637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.155420 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.155423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:43.156052 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:43.156062 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.156551 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.156555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:43.156643 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:43.157252 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:43.157266 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:43.159267 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":125,"threads_started":1}
W20260807 02:17:43.159557 14779 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:43.153761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:53221 (local address 127.1.126.254:38189)
0807 02:17:43.153914 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:43.153920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:43.154088 (+ 168us) server_negotiation.cc:407] Connection header received
0807 02:17:43.154192 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:43.154194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:43.154242 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:43.154313 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:43.154746 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.155314 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.156190 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.156413 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.156536 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:43.159398 (+ 2862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.195:53221: BlockingRecv error: recv got EOF from 127.1.126.195:53221 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 02:17:43 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:43 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.193@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:43.781226 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:43.775872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.193:46161)
0807 02:17:43.776174 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:43.776198 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:43.776288 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:43.776527 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:43.776529 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:43.776711 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:43.776807 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:43.776812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.777520 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.777523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:43.778060 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:43.778067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.778471 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.778475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:43.778555 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:43.779184 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:43.779199 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:43.781071 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":74,"threads_started":1}
W20260807 02:17:43.781343 14786 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:43.775999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:46161 (local address 127.1.126.254:38189)
0807 02:17:43.776265 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:43.776269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:43.776282 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:17:43.776370 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:43.776372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:43.776414 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:43.776488 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:43.776908 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.777429 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.778157 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.778364 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.778435 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:43.781217 (+ 2782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.193:46161: BlockingRecv error: recv got EOF from 127.1.126.193:46161 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":100,"threads_started":1}
Aug 07 02:17:43 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 02:17:43 dist-test-slave-39l8 krb5kdc[13244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.126.194@KRBTEST.COM for oryx/127.1.126.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 02:17:43.962872 14788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:43.957470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38189 (local address 127.1.126.194:49985)
0807 02:17:43.957748 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:43.957770 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:43.957881 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:43.958132 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:43.958135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:43.958328 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:43.958422 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:43.958427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.959228 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.959230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:43.959743 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:43.959750 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.960213 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.960218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:43.960289 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:43.960770 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:43.960782 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:43.962671 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.126.254:38189: Server oryx/127.1.126.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":123,"threads_started":1}
W20260807 02:17:43.962939 14786 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:43.957534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:49985 (local address 127.1.126.254:38189)
0807 02:17:43.957687 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:43.957691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:43.957837 (+ 146us) server_negotiation.cc:407] Connection header received
0807 02:17:43.957965 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:43.957968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:43.958010 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:43.958080 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:43.958517 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.959116 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.959831 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:43.960090 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:43.960185 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:43.962817 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.126.194:49985: BlockingRecv error: recv got EOF from 127.1.126.194:49985 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:17:44.054124 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 14112
I20260807 02:17:44.065850 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 14314
I20260807 02:17:44.072463 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 14518
I20260807 02:17:44.085481 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 14004
2026-08-07T02:17:44Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18090 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T02:17:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:44Z Disabled control of system clock
I20260807 02:17:44.123162 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38819
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:38819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 02:17:44.234867 14794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:44.235136 14794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:44.235169 14794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:44.239188 14794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:44.239246 14794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:44.239264 14794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:44.239280 14794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:44.239296 14794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:44.243959 14794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:38819
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:44.245021 14794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:44.246384 14794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:44.255065 14805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:44.255141 14794 server_base.cc:1034] running on GCE node
W20260807 02:17:44.255038 14803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:44.255052 14802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:44.255860 14794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:44.256956 14794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:44.258165 14794 hybrid_clock.cc:648] HybridClock initialized: now 1786069064258143 us; error 44 us; skew 500 ppm
I20260807 02:17:44.264344 14794 webserver.cc:460] Webserver started at http://127.1.126.254:41753/ using document root <none> and password file <none>
I20260807 02:17:44.264904 14794 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:44.264961 14794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:44.265137 14794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:44.267225 14794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "fdeb3f1f86cd46e29c834fe578909ff6"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "33262619e30feee72bee3baae0c9acd7"
server_key_iv: "050c2c5fcec793f36d22738e3dfc8c72"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.267758 14794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "fdeb3f1f86cd46e29c834fe578909ff6"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "33262619e30feee72bee3baae0c9acd7"
server_key_iv: "050c2c5fcec793f36d22738e3dfc8c72"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.271384 14794 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:17:44.273687 14815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.274935 14794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:44.275074 14794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "fdeb3f1f86cd46e29c834fe578909ff6"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "33262619e30feee72bee3baae0c9acd7"
server_key_iv: "050c2c5fcec793f36d22738e3dfc8c72"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.275197 14794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:44.290339 14794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:44.291049 14794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:44.291246 14794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:44.298154 14888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:38819 every 8 connection(s)
I20260807 02:17:44.298157 14794 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:38819
I20260807 02:17:44.299160 14794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:44.301887 14889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:44.307943 14889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6: Bootstrap starting.
I20260807 02:17:44.309011 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 14794
I20260807 02:17:44.309160 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:44.309440 1531 external_mini_cluster.cc:1428] Setting key 190c0c33c925c4cd01c41180cae386fd
I20260807 02:17:44.310686 14889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:44.311470 14889 log.cc:824] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:44.313483 14889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6: No bootstrap required, opened a new log
I20260807 02:17:44.317682 14889 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38819 } }
I20260807 02:17:44.317880 14889 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:44.318001 14889 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdeb3f1f86cd46e29c834fe578909ff6, State: Initialized, Role: FOLLOWER
I20260807 02:17:44.318462 14889 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38819 } }
I20260807 02:17:44.318580 14889 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:44.318663 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.310516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53612 (local address 127.1.126.254:38819)
0807 02:17:44.311205 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:44.311219 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:44.311252 (+ 33us) server_negotiation.cc:407] Connection header received
0807 02:17:44.311918 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:44.311937 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:44.312258 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:44.312571 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:44.312916 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.314071 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.315284 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.315742 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.315857 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.316704 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:44.316709 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:44.316721 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:44.317074 (+ 353us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:44.317123 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:44.317142 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:44.317218 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:44.317409 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 02:17:44.317698 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":177,"threads_started":1}
I20260807 02:17:44.318663 14889 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:44.318859 14889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:44.319736 14889 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38819 } }
I20260807 02:17:44.320081 14889 leader_election.cc:302] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdeb3f1f86cd46e29c834fe578909ff6; no voters:
I20260807 02:17:44.320438 14889 leader_election.cc:288] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:44.320546 14897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:44.320799 14897 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [term 1 LEADER]: Becoming Leader. State: Replica: fdeb3f1f86cd46e29c834fe578909ff6, State: Running, Role: LEADER
I20260807 02:17:44.321111 14897 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38819 } }
I20260807 02:17:44.321695 14889 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:44.322243 14898 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38819 } } }
I20260807 02:17:44.322364 14898 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:44.322743 14899 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdeb3f1f86cd46e29c834fe578909ff6. Latest consensus state: current_term: 1 leader_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdeb3f1f86cd46e29c834fe578909ff6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38819 } } }
I20260807 02:17:44.322855 14899 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:44.323119 14902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:44.326277 14902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:44.332080 14902 catalog_manager.cc:1347] Generated new cluster ID: d06276c0136a41a0a12841a18a077c6b
I20260807 02:17:44.332192 14902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:44.349330 14902 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:44.350244 14902 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:44.355278 14902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdeb3f1f86cd46e29c834fe578909ff6: Generated new TSK 0
I20260807 02:17:44.355932 14902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:44.361644 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38819
--builtin_ntp_servers=127.1.126.212:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 02:17:44.492962 14925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:44.493207 14925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:44.493243 14925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:44.497238 14925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:44.497287 14925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:44.497370 14925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:44.502107 14925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:44.503129 14925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:44.504472 14925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:44.514292 14932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:44.514304 14931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:44.514460 14925 server_base.cc:1034] running on GCE node
W20260807 02:17:44.514304 14938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:44.514956 14925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:44.515551 14925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:44.516714 14925 hybrid_clock.cc:648] HybridClock initialized: now 1786069064516690 us; error 34 us; skew 500 ppm
I20260807 02:17:44.518458 14925 webserver.cc:460] Webserver started at http://127.1.126.193:42139/ using document root <none> and password file <none>
I20260807 02:17:44.519081 14925 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:44.519181 14925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:44.519415 14925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:44.521420 14925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "9c099fb8797544878c2450bdf0b02c3b"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "63b9dc57983f683ce2ea4b5ac8a35058"
server_key_iv: "4d98d4cc8cc25431dbd6ce73930a62cc"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.521993 14925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "9c099fb8797544878c2450bdf0b02c3b"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "63b9dc57983f683ce2ea4b5ac8a35058"
server_key_iv: "4d98d4cc8cc25431dbd6ce73930a62cc"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.525563 14925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:44.527964 14945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.529048 14925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:44.529194 14925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "9c099fb8797544878c2450bdf0b02c3b"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "63b9dc57983f683ce2ea4b5ac8a35058"
server_key_iv: "4d98d4cc8cc25431dbd6ce73930a62cc"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.529302 14925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:44.563773 14925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:44.564528 14925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:44.564742 14925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:44.565378 14925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:44.566367 14925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:44.566442 14925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.566515 14925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:44.566558 14925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.575404 14925 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:37335
I20260807 02:17:44.575428 15111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:37335 every 8 connection(s)
I20260807 02:17:44.576398 14925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:44.579564 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 14925
I20260807 02:17:44.579701 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:44.580020 1531 external_mini_cluster.cc:1428] Setting key 4993f67db2154216c8c06170e2897a72
I20260807 02:17:44.582020 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38819
--builtin_ntp_servers=127.1.126.212:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 02:17:44.586352 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.578258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:51103 (local address 127.1.126.254:38819)
0807 02:17:44.578392 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:44.578395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:44.579587 (+ 1192us) server_negotiation.cc:407] Connection header received
0807 02:17:44.581211 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:44.581213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:44.581274 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:44.581363 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:44.582473 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.583111 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.584261 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.584484 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.584594 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.585738 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:44.585745 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:44.585751 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:44.585768 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:44.585794 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:44.585807 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:44.585888 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:44.586051 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 02:17:44.586125 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:17:44.587203 15116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.578728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38819 (local address 127.1.126.193:51103)
0807 02:17:44.579453 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:44.579493 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:44.580996 (+ 1503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:44.581726 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:44.581732 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:44.581808 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:44.582335 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:44.582349 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.583250 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.583272 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:44.584121 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:44.584130 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.584640 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.584644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:44.584807 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.585452 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:44.585454 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:44.585501 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:44.585572 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:44.585897 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:44.585907 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:44.585912 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 02:17:44.586034 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 02:17:44.586284 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260807 02:17:44.588384 15114 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38819
I20260807 02:17:44.588640 15114 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:44.589283 15114 heartbeater.cc:511] Master 127.1.126.254:38819 requested a full tablet report, sending...
I20260807 02:17:44.590899 14844 ts_manager.cc:194] Registered new tserver with Master: 9c099fb8797544878c2450bdf0b02c3b (127.1.126.193:37335)
I20260807 02:17:44.592022 14844 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.193:51103
W20260807 02:17:44.699545 15117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:44.699774 15117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:44.699834 15117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:44.703776 15117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:44.703823 15117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:44.703903 15117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:44.708544 15117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:44.709504 15117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:44.711024 15117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:44.720301 15126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:44.720357 15130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:44.720357 15128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:44.720535 15117 server_base.cc:1034] running on GCE node
I20260807 02:17:44.721031 15117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:44.721632 15117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:44.722781 15117 hybrid_clock.cc:648] HybridClock initialized: now 1786069064722769 us; error 41 us; skew 500 ppm
I20260807 02:17:44.724568 15117 webserver.cc:460] Webserver started at http://127.1.126.194:38533/ using document root <none> and password file <none>
I20260807 02:17:44.725152 15117 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:44.725258 15117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:44.725495 15117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:44.727558 15117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "166b22c1f9eb40a2a69f0b72d380fbc5"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "ea724260f9a584f0f559ce5259e4edd4"
server_key_iv: "010ffa7de29f4cdb5c0f38ddb10bfccb"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.728107 15117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "166b22c1f9eb40a2a69f0b72d380fbc5"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "ea724260f9a584f0f559ce5259e4edd4"
server_key_iv: "010ffa7de29f4cdb5c0f38ddb10bfccb"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.731770 15117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:44.734375 15139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.735666 15117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:44.735805 15117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "166b22c1f9eb40a2a69f0b72d380fbc5"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "ea724260f9a584f0f559ce5259e4edd4"
server_key_iv: "010ffa7de29f4cdb5c0f38ddb10bfccb"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.735921 15117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:44.748129 15117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:44.748795 15117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:44.748989 15117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:44.749652 15117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:44.750599 15117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:44.750682 15117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.750769 15117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:44.750813 15117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.759423 15117 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:45715
I20260807 02:17:44.759452 15306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:45715 every 8 connection(s)
I20260807 02:17:44.760344 15117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:44.769644 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.762270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:56513 (local address 127.1.126.254:38819)
0807 02:17:44.762407 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:44.762411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:44.763424 (+ 1013us) server_negotiation.cc:407] Connection header received
0807 02:17:44.764860 (+ 1436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:44.764864 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:44.764925 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:44.765047 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:44.765924 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.766461 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.767686 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.767911 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.768037 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.769133 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:44.769137 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:44.769140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:44.769160 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:44.769179 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:44.769186 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:44.769269 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:44.769438 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 02:17:44.769499 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:17:44.769999 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 15117
I20260807 02:17:44.770133 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:44.770427 1531 external_mini_cluster.cc:1428] Setting key c058684ad38faedadf73e47873cec7fe
I20260807 02:17:44.770568 15313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.762576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38819 (local address 127.1.126.194:56513)
0807 02:17:44.763257 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:44.763314 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:44.764643 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:44.765216 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:44.765222 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:44.765306 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:44.765777 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:44.765790 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.766608 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.766612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:44.767549 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:44.767559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.768069 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.768073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:44.768238 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.768869 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:44.768871 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:44.768909 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:44.768971 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:44.769271 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:44.769283 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:44.769293 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 02:17:44.769430 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 02:17:44.769703 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":172,"threads_started":1}
I20260807 02:17:44.771781 15311 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38819
I20260807 02:17:44.772017 15311 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:44.772624 15311 heartbeater.cc:511] Master 127.1.126.254:38819 requested a full tablet report, sending...
I20260807 02:17:44.772845 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38819
--builtin_ntp_servers=127.1.126.212:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 02:17:44.773886 14843 ts_manager.cc:194] Registered new tserver with Master: 166b22c1f9eb40a2a69f0b72d380fbc5 (127.1.126.194:45715)
I20260807 02:17:44.774828 14843 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.194:56513
W20260807 02:17:44.888022 15315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:44.888307 15315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:44.888404 15315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:44.892481 15315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:44.892556 15315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:44.892642 15315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:44.897262 15315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:44.898279 15315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:44.899682 15315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:44.908846 15325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:44.908855 15323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:44.908855 15322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:44.909096 15315 server_base.cc:1034] running on GCE node
I20260807 02:17:44.909607 15315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:44.910159 15315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:44.911322 15315 hybrid_clock.cc:648] HybridClock initialized: now 1786069064911303 us; error 30 us; skew 500 ppm
I20260807 02:17:44.913147 15315 webserver.cc:460] Webserver started at http://127.1.126.195:45837/ using document root <none> and password file <none>
I20260807 02:17:44.913669 15315 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:44.913745 15315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:44.913908 15315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:44.915880 15315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "a318327cb0944f4198466ae574815437"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "0424e62022e1341351985c56dac57991"
server_key_iv: "aa0af3057f967ce8a3c0b01eba00452c"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.916383 15315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "a318327cb0944f4198466ae574815437"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "0424e62022e1341351985c56dac57991"
server_key_iv: "aa0af3057f967ce8a3c0b01eba00452c"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.920094 15315 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:44.922574 15338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.923907 15315 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:44.924001 15315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a318327cb0944f4198466ae574815437"
format_stamp: "Formatted at 2026-08-07 02:17:44 on dist-test-slave-39l8"
server_key: "0424e62022e1341351985c56dac57991"
server_key_iv: "aa0af3057f967ce8a3c0b01eba00452c"
server_key_version: "encryptionkey@0"
I20260807 02:17:44.924083 15315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:44.936417 15315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:44.936992 15315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:44.937131 15315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:44.937611 15315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:44.938463 15315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:44.938511 15315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.938548 15315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:44.938570 15315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:44.947584 15315 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:39781
I20260807 02:17:44.947605 15509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:39781 every 8 connection(s)
I20260807 02:17:44.948405 15315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:44.950027 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 15315
I20260807 02:17:44.950126 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:44.950403 1531 external_mini_cluster.cc:1428] Setting key 2e0ecc0a08cb1e397bb2767cf0ef53bb
I20260807 02:17:44.957767 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.950117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:44139 (local address 127.1.126.254:38819)
0807 02:17:44.950266 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:44.950271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:44.951543 (+ 1272us) server_negotiation.cc:407] Connection header received
0807 02:17:44.953137 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:44.953139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:44.953187 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:44.953265 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:44.954050 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.954678 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.955818 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.956053 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.956141 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.957191 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:44.957195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:44.957197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:44.957208 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:44.957225 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:44.957233 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:44.957305 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:44.957609 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 02:17:44.957659 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:17:44.958411 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:44.950542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38819 (local address 127.1.126.195:44139)
0807 02:17:44.951368 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:44.951419 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:44.952958 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:44.953415 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:44.953422 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:44.953496 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:44.953937 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:44.953949 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.954855 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.954857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:44.955676 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:44.955685 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:44.956188 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:44.956191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:44.956340 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:44.956955 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:44.956956 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:44.956993 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:44.957052 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:44.957313 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:44.957320 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:44.957324 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:17:44.957413 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 02:17:44.957607 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":202,"threads_started":1}
I20260807 02:17:44.959537 15510 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38819
I20260807 02:17:44.959757 15510 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:44.960242 15510 heartbeater.cc:511] Master 127.1.126.254:38819 requested a full tablet report, sending...
I20260807 02:17:44.961172 14843 ts_manager.cc:194] Registered new tserver with Master: a318327cb0944f4198466ae574815437 (127.1.126.195:39781)
I20260807 02:17:44.961711 14843 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.195:44139
I20260807 02:17:44.964218 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 02:17:44.967106 14895 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:44.966117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53616 (local address 127.1.126.254:38819)
0807 02:17:44.966252 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:44.966256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:44.966466 (+ 210us) server_negotiation.cc:407] Connection header received
0807 02:17:44.966547 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:44.966549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:44.966583 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:44.966649 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:44.966966 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53616: BlockingRecv error: recv got EOF from 127.0.0.1:53616 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:17:44.967229 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 14925
I20260807 02:17:44.981300 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 15117
I20260807 02:17:44.991773 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 15315
I20260807 02:17:44.999452 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 14794
2026-08-07T02:17:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (911 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T02:17:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:45Z Disabled control of system clock
I20260807 02:17:45.034462 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:35669
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:39443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:35669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 02:17:45.145334 15524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:45.145588 15524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:45.145630 15524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:45.149677 15524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:45.149741 15524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:45.149755 15524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:45.149791 15524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:45.149806 15524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:45.154495 15524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:35669
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:35669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:45.155565 15524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:45.156973 15524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:45.165781 15535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.165791 15532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:45.165941 15524 server_base.cc:1034] running on GCE node
W20260807 02:17:45.165846 15529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:45.166642 15524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:45.167722 15524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:45.168881 15524 hybrid_clock.cc:648] HybridClock initialized: now 1786069065168854 us; error 40 us; skew 500 ppm
I20260807 02:17:45.170646 15524 webserver.cc:460] Webserver started at http://127.1.126.254:33975/ using document root <none> and password file <none>
I20260807 02:17:45.171257 15524 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:45.171319 15524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:45.171577 15524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:45.173631 15524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "ce7f18d407c843609f43246e1669d0e3"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "3dd5a7c7c3d65f367d77e97892e3bf53"
server_key_iv: "2e689027a923c57fd65e4d6b8f065d5d"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.174207 15524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "ce7f18d407c843609f43246e1669d0e3"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "3dd5a7c7c3d65f367d77e97892e3bf53"
server_key_iv: "2e689027a923c57fd65e4d6b8f065d5d"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.177838 15524 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:45.180336 15543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.181525 15524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:17:45.181663 15524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "ce7f18d407c843609f43246e1669d0e3"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "3dd5a7c7c3d65f367d77e97892e3bf53"
server_key_iv: "2e689027a923c57fd65e4d6b8f065d5d"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.181772 15524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:45.186229 15524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:45.186894 15524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:45.187065 15524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:45.194336 15524 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:35669
I20260807 02:17:45.194366 15616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:35669 every 8 connection(s)
I20260807 02:17:45.195257 15524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:45.198905 15617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:45.200194 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 15524
I20260807 02:17:45.200330 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:45.200627 1531 external_mini_cluster.cc:1428] Setting key 17ff8dede9fc751c575dc352b8c99579
I20260807 02:17:45.205768 15617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3: Bootstrap starting.
I20260807 02:17:45.206775 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.202165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54550 (local address 127.1.126.254:35669)
0807 02:17:45.202860 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:45.202880 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:45.202923 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:17:45.203829 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:45.203854 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:45.204304 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:45.204667 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:45.205351 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:45.205357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:45.205370 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:45.205381 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:45.205441 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:45.205465 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:45.205608 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:45.205676 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 02:17:45.205911 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":102,"threads_started":1}
I20260807 02:17:45.208173 15617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:45.208899 15617 log.cc:824] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:45.210662 15617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3: No bootstrap required, opened a new log
I20260807 02:17:45.213990 15617 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7f18d407c843609f43246e1669d0e3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 35669 } }
I20260807 02:17:45.214259 15617 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:45.214344 15617 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7f18d407c843609f43246e1669d0e3, State: Initialized, Role: FOLLOWER
I20260807 02:17:45.214811 15617 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7f18d407c843609f43246e1669d0e3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 35669 } }
I20260807 02:17:45.214938 15617 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:45.214987 15617 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:45.215061 15617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:45.215916 15617 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7f18d407c843609f43246e1669d0e3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 35669 } }
I20260807 02:17:45.216199 15617 leader_election.cc:302] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce7f18d407c843609f43246e1669d0e3; no voters:
I20260807 02:17:45.216432 15617 leader_election.cc:288] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:45.216562 15628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:45.216833 15628 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [term 1 LEADER]: Becoming Leader. State: Replica: ce7f18d407c843609f43246e1669d0e3, State: Running, Role: LEADER
I20260807 02:17:45.217140 15628 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7f18d407c843609f43246e1669d0e3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 35669 } }
I20260807 02:17:45.217635 15617 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:45.218803 15629 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce7f18d407c843609f43246e1669d0e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7f18d407c843609f43246e1669d0e3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 35669 } } }
I20260807 02:17:45.218947 15629 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:45.219333 15639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:45.218803 15630 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce7f18d407c843609f43246e1669d0e3. Latest consensus state: current_term: 1 leader_uuid: "ce7f18d407c843609f43246e1669d0e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7f18d407c843609f43246e1669d0e3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 35669 } } }
I20260807 02:17:45.219391 15630 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:45.222235 15639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:45.227208 15639 catalog_manager.cc:1347] Generated new cluster ID: ac0d8e4cdcdb4f1b921deafe350a497d
I20260807 02:17:45.227274 15639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:45.258512 15639 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:45.258932 15639 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:45.267189 15639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce7f18d407c843609f43246e1669d0e3: Generated new TSK 0
I20260807 02:17:45.267863 15639 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:17:45.272374 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:35669
--builtin_ntp_servers=127.1.126.212:39443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 02:17:45.388048 15653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:45.388278 15653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:45.388345 15653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:45.392179 15653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:45.392228 15653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:45.392316 15653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:45.396870 15653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:35669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:45.398110 15653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:45.399544 15653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:45.409144 15663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.409124 15660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.409116 15659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:45.409422 15653 server_base.cc:1034] running on GCE node
I20260807 02:17:45.409920 15653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:45.410516 15653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:45.411692 15653 hybrid_clock.cc:648] HybridClock initialized: now 1786069065411673 us; error 31 us; skew 500 ppm
I20260807 02:17:45.413416 15653 webserver.cc:460] Webserver started at http://127.1.126.193:34909/ using document root <none> and password file <none>
I20260807 02:17:45.413991 15653 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:45.414083 15653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:45.414316 15653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:45.416333 15653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "e2cb547b8d874af5ae1878b98ab066c6"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "22dc204378b8c57683b4d6efcd2372d3"
server_key_iv: "2d99ba1a9c49365af856a2e80dfe2f3d"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.416875 15653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "e2cb547b8d874af5ae1878b98ab066c6"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "22dc204378b8c57683b4d6efcd2372d3"
server_key_iv: "2d99ba1a9c49365af856a2e80dfe2f3d"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.420665 15653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 02:17:45.423303 15670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.424431 15653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:17:45.424562 15653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "e2cb547b8d874af5ae1878b98ab066c6"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "22dc204378b8c57683b4d6efcd2372d3"
server_key_iv: "2d99ba1a9c49365af856a2e80dfe2f3d"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.424680 15653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:45.428960 15653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:45.429505 15653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:45.429678 15653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:45.430174 15653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:45.431118 15653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:45.431186 15653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.431252 15653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:45.431299 15653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.439700 15653 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:45065
I20260807 02:17:45.439774 15831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:45065 every 8 connection(s)
I20260807 02:17:45.440531 15653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:45.446100 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.442248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:48387 (local address 127.1.126.254:35669)
0807 02:17:45.442375 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:45.442385 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:45.443396 (+ 1011us) server_negotiation.cc:407] Connection header received
0807 02:17:45.444626 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:45.444629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:45.444667 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:45.444743 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:45.445726 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:45.445729 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:45.445731 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:45.445743 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:45.445763 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:45.445772 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:45.445849 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:45.445965 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 02:17:45.446000 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:17:45.447018 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.442558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:35669 (local address 127.1.126.193:48387)
0807 02:17:45.443254 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:45.443291 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:45.444441 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:45.444897 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:45.444903 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:45.444996 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:45.445487 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:45.445488 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:45.445524 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:45.445585 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:45.445848 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:45.445855 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:45.445859 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:17:45.445978 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 02:17:45.446192 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":172,"threads_started":1}
I20260807 02:17:45.448163 15832 heartbeater.cc:347] Connected to a master server at 127.1.126.254:35669
I20260807 02:17:45.448380 15832 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:45.448751 15832 heartbeater.cc:511] Master 127.1.126.254:35669 requested a full tablet report, sending...
I20260807 02:17:45.449441 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 15653
I20260807 02:17:45.449563 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:45.449877 1531 external_mini_cluster.cc:1428] Setting key 08f60a695292ef5ca99efcc5e70958f9
I20260807 02:17:45.450156 15566 ts_manager.cc:194] Registered new tserver with Master: e2cb547b8d874af5ae1878b98ab066c6 (127.1.126.193:45065)
I20260807 02:17:45.451930 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:35669
--builtin_ntp_servers=127.1.126.212:39443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 02:17:45.560068 15837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:45.560420 15837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:45.560513 15837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:45.564908 15837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:45.564958 15837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:45.565011 15837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:45.569545 15837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:35669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:45.570492 15837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:45.571772 15837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:45.581254 15847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.581250 15849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.581271 15845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:45.581533 15837 server_base.cc:1034] running on GCE node
I20260807 02:17:45.581928 15837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:45.582548 15837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:45.583735 15837 hybrid_clock.cc:648] HybridClock initialized: now 1786069065583722 us; error 28 us; skew 500 ppm
I20260807 02:17:45.585525 15837 webserver.cc:460] Webserver started at http://127.1.126.194:43899/ using document root <none> and password file <none>
I20260807 02:17:45.586155 15837 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:45.586256 15837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:45.586481 15837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:45.588657 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "a18d085e73554fd593d57ce152605c8e"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "6d379ebf94f9caab210698a3db9ed5cb"
server_key_iv: "a5ec39e3adb1d690317d3a8515236911"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.589259 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "a18d085e73554fd593d57ce152605c8e"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "6d379ebf94f9caab210698a3db9ed5cb"
server_key_iv: "a5ec39e3adb1d690317d3a8515236911"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.592859 15837 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:45.595350 15858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.596570 15837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:45.596719 15837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "a18d085e73554fd593d57ce152605c8e"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "6d379ebf94f9caab210698a3db9ed5cb"
server_key_iv: "a5ec39e3adb1d690317d3a8515236911"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.596833 15837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:45.601347 15837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:45.601927 15837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:45.602103 15837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:45.602648 15837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:45.603554 15837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:45.603631 15837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.603715 15837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:45.603767 15837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.612464 15837 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:40703
I20260807 02:17:45.612484 16010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:40703 every 8 connection(s)
I20260807 02:17:45.613281 15837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:45.618341 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 15837
I20260807 02:17:45.618479 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:45.618898 1531 external_mini_cluster.cc:1428] Setting key 471db495bed3e0810b2cb289f1b4ffe1
I20260807 02:17:45.619365 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.615054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:39503 (local address 127.1.126.254:35669)
0807 02:17:45.615230 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:45.615234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:45.616180 (+ 946us) server_negotiation.cc:407] Connection header received
0807 02:17:45.617479 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:45.617482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:45.617518 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:45.617591 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:45.618810 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:45.618815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:45.618818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:45.618833 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:45.618858 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:45.618869 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:45.618972 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:45.619169 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 02:17:45.619216 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 02:17:45.620177 16015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.615440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:35669 (local address 127.1.126.194:39503)
0807 02:17:45.616039 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:45.616075 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:45.617202 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:45.617796 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:45.617802 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:45.617882 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:45.618471 (+ 589us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:45.618474 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:45.618528 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:45.618615 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:45.618999 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:45.619009 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:45.619016 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 02:17:45.619157 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 02:17:45.619366 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":109,"threads_started":1}
I20260807 02:17:45.620967 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:35669
--builtin_ntp_servers=127.1.126.212:39443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 02:17:45.621337 16011 heartbeater.cc:347] Connected to a master server at 127.1.126.254:35669
I20260807 02:17:45.621562 16011 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:45.621935 16011 heartbeater.cc:511] Master 127.1.126.254:35669 requested a full tablet report, sending...
I20260807 02:17:45.623055 15566 ts_manager.cc:194] Registered new tserver with Master: a18d085e73554fd593d57ce152605c8e (127.1.126.194:40703)
W20260807 02:17:45.732753 16018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:45.732980 16018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:45.733047 16018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:45.737011 16018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:45.737057 16018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:45.737139 16018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:45.741832 16018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:39443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:35669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:45.742892 16018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:45.744184 16018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:45.753226 16024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.753242 16026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:45.753248 16023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:45.753317 16018 server_base.cc:1034] running on GCE node
I20260807 02:17:45.753798 16018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:45.754343 16018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:45.755527 16018 hybrid_clock.cc:648] HybridClock initialized: now 1786069065755505 us; error 39 us; skew 500 ppm
I20260807 02:17:45.757231 16018 webserver.cc:460] Webserver started at http://127.1.126.195:44713/ using document root <none> and password file <none>
I20260807 02:17:45.757790 16018 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:45.757886 16018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:45.758117 16018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:45.760200 16018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "22dd61ed313f435ea5774b6724ac90b6"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "6547e7a6f0854153f87c72db28d847fe"
server_key_iv: "c54207f5ea7d237181c08583c6f018e5"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.760761 16018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "22dd61ed313f435ea5774b6724ac90b6"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "6547e7a6f0854153f87c72db28d847fe"
server_key_iv: "c54207f5ea7d237181c08583c6f018e5"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.764241 16018 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:45.766553 16040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.767746 16018 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:17:45.767947 16018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "22dd61ed313f435ea5774b6724ac90b6"
format_stamp: "Formatted at 2026-08-07 02:17:45 on dist-test-slave-39l8"
server_key: "6547e7a6f0854153f87c72db28d847fe"
server_key_iv: "c54207f5ea7d237181c08583c6f018e5"
server_key_version: "encryptionkey@0"
I20260807 02:17:45.768059 16018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:45.772476 16018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:45.773036 16018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:45.773216 16018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:45.773739 16018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:45.774596 16018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:45.774677 16018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.774765 16018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:45.774809 16018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:45.783556 16018 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:40181
I20260807 02:17:45.783584 16200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:40181 every 8 connection(s)
I20260807 02:17:45.784369 16018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:45.788061 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 16018
I20260807 02:17:45.788203 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:45.788544 1531 external_mini_cluster.cc:1428] Setting key 4f6dcd8cdaaf6b79d25658f102f26dd4
I20260807 02:17:45.790819 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.786118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:40817 (local address 127.1.126.254:35669)
0807 02:17:45.786259 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:45.786263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:45.787378 (+ 1115us) server_negotiation.cc:407] Connection header received
0807 02:17:45.788944 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:45.788948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:45.788995 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:45.789083 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:45.790345 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:45.790349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:45.790352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:17:45.790364 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:45.790384 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:17:45.790394 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:45.790483 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:45.790626 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 02:17:45.790670 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:17:45.791605 16204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:45.786565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:35669 (local address 127.1.126.195:40817)
0807 02:17:45.787243 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:45.787279 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:45.788706 (+ 1427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:45.789280 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:45.789293 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:45.789401 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:45.790061 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:17:45.790063 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:45.790110 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:17:45.790208 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:45.790490 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:45.790497 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:45.790501 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:17:45.790620 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 02:17:45.790895 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":166,"threads_started":1}
I20260807 02:17:45.792591 16202 heartbeater.cc:347] Connected to a master server at 127.1.126.254:35669
I20260807 02:17:45.792815 16202 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:45.793210 16202 heartbeater.cc:511] Master 127.1.126.254:35669 requested a full tablet report, sending...
I20260807 02:17:45.794189 15566 ts_manager.cc:194] Registered new tserver with Master: 22dd61ed313f435ea5774b6724ac90b6 (127.1.126.195:40181)
I20260807 02:17:45.802407 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 02:17:45.805106 15624 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:17:45.804381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.1.126.254:35669)
0807 02:17:45.804491 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:45.804494 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:45.804664 (+ 170us) server_negotiation.cc:407] Connection header received
0807 02:17:45.804762 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:45.804764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:45.804791 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:45.804849 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:45.805020 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54564: BlockingRecv error: recv got EOF from 127.0.0.1:54564 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 02:17:45.805335 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 15653
I20260807 02:17:45.827502 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 15837
I20260807 02:17:45.842882 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 16018
I20260807 02:17:45.856329 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 15524
2026-08-07T02:17:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (857 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:45 dist-test-slave-39l8 krb5kdc[16220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:45 dist-test-slave-39l8 krb5kdc[16220](info): set up 2 sockets
Aug 07 02:17:45 dist-test-slave-39l8 krb5kdc[16220](info): commencing operation
krb5kdc: starting...
W20260807 02:17:47.056602 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:17:47.179503 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38223
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:38223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:47.289574 16238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:47.289815 16238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:47.289853 16238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:47.293784 16238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:17:47.293835 16238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:47.293859 16238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:47.293893 16238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:17:47.293907 16238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:17:47.298990 16238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:38223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:38223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:47.299925 16238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:47.300874 16238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:47.309237 16245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:47.309249 16246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:47.309249 16248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:47.309563 16238 server_base.cc:1034] running on GCE node
I20260807 02:17:47.310191 16238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:47.311297 16238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:47.312476 16238 hybrid_clock.cc:648] HybridClock initialized: now 1786069067312458 us; error 30 us; skew 500 ppm
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:47.320987 16238 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:17:47.321945 16238 webserver.cc:460] Webserver started at http://127.1.126.254:36001/ using document root <none> and password file <none>
I20260807 02:17:47.322546 16238 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:47.322613 16238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:47.322875 16238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:47.324970 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "59c879c16d884981a421a589711da265"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "2d834df98750fbff69186f6928cc378d"
server_key_iv: "88d11074bfdccfea949e3b583be7f6d9"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.325547 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "59c879c16d884981a421a589711da265"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "2d834df98750fbff69186f6928cc378d"
server_key_iv: "88d11074bfdccfea949e3b583be7f6d9"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.329310 16238 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:17:47.331826 16256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.333191 16238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:17:47.333340 16238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "59c879c16d884981a421a589711da265"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "2d834df98750fbff69186f6928cc378d"
server_key_iv: "88d11074bfdccfea949e3b583be7f6d9"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.333453 16238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:47.345644 16238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:47.348958 16238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:47.349208 16238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:47.356511 16238 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:38223
I20260807 02:17:47.356791 16337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:38223 every 8 connection(s)
I20260807 02:17:47.357492 16238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:17:47.360317 16338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:47.365765 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 16238
I20260807 02:17:47.365869 16338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265: Bootstrap starting.
I20260807 02:17:47.365901 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:17:47.366233 1531 external_mini_cluster.cc:1428] Setting key 07a967d3ad7ad1d54332454302e61da7
I20260807 02:17:47.368546 16338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:47.369338 16338 log.cc:824] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:47.371341 16338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265: No bootstrap required, opened a new log
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:47.375690 16338 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c879c16d884981a421a589711da265" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38223 } }
I20260807 02:17:47.375944 16338 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:47.376035 16338 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c879c16d884981a421a589711da265, State: Initialized, Role: FOLLOWER
I20260807 02:17:47.376516 16338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c879c16d884981a421a589711da265" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38223 } }
I20260807 02:17:47.376677 16338 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:17:47.376865 16338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:17:47.376996 16338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:47.378183 16338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c879c16d884981a421a589711da265" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38223 } }
I20260807 02:17:47.378531 16338 leader_election.cc:302] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c879c16d884981a421a589711da265; no voters:
I20260807 02:17:47.378945 16338 leader_election.cc:288] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:17:47.379014 16344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:47.379242 16344 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [term 1 LEADER]: Becoming Leader. State: Replica: 59c879c16d884981a421a589711da265, State: Running, Role: LEADER
I20260807 02:17:47.379603 16344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c879c16d884981a421a589711da265" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38223 } }
I20260807 02:17:47.380290 16338 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:17:47.381399 16346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c879c16d884981a421a589711da265. Latest consensus state: current_term: 1 leader_uuid: "59c879c16d884981a421a589711da265" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c879c16d884981a421a589711da265" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38223 } } }
I20260807 02:17:47.381549 16346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:47.381563 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:47.367584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35456 (local address 127.1.126.254:38223)
0807 02:17:47.368011 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:47.368027 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:47.368061 (+ 34us) server_negotiation.cc:407] Connection header received
0807 02:17:47.368739 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:47.368757 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:47.369069 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:47.369340 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:47.370214 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.371246 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.372358 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.372803 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.372928 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:47.375782 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:47.375787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:47.375799 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:47.375826 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:47.377949 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:47.378411 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:47.378416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:47.378421 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:47.378531 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:47.378866 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:47.378870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:47.378872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:47.379366 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:47.380154 (+ 788us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:47.380274 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 02:17:47.380585 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":141,"threads_started":1}
I20260807 02:17:47.382776 16347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59c879c16d884981a421a589711da265" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c879c16d884981a421a589711da265" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 38223 } } }
I20260807 02:17:47.382859 16356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:17:47.385478 16356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:17:47.386737 16347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265 [sys.catalog]: This master's current role is: LEADER
I20260807 02:17:47.390952 16356 catalog_manager.cc:1347] Generated new cluster ID: 6e66b661c274480a9f4cbbdd668c5d75
I20260807 02:17:47.391014 16356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:17:47.414943 16356 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:17:47.416020 16356 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:17:47.422958 16356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265: Generated new TSK 0
I20260807 02:17:47.423602 16356 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:17:47.453647 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38223
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:47.565847 16375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:47.566087 16375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:47.566128 16375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:47.570143 16375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:47.570204 16375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:47.570259 16375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:17:47.575366 16375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:47.576382 16375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:47.577389 16375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:47.587013 16385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:47.587056 16382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:47.587072 16383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:47.587397 16375 server_base.cc:1034] running on GCE node
I20260807 02:17:47.587783 16375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:47.588418 16375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:47.589577 16375 hybrid_clock.cc:648] HybridClock initialized: now 1786069067589555 us; error 33 us; skew 500 ppm
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:47.592276 16375 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:17:47.593083 16375 webserver.cc:460] Webserver started at http://127.1.126.193:38455/ using document root <none> and password file <none>
I20260807 02:17:47.593675 16375 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:47.593771 16375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:47.594019 16375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:47.596028 16375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "15b356c01c664cc18d57fa52aca92dae"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "a49818199ea459e500b5ce64952691dc"
server_key_iv: "35cff8b976ddb4ab84813d7db548d197"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.596577 16375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "15b356c01c664cc18d57fa52aca92dae"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "a49818199ea459e500b5ce64952691dc"
server_key_iv: "35cff8b976ddb4ab84813d7db548d197"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.600143 16375 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:17:47.602504 16392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.603705 16375 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:47.603837 16375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "15b356c01c664cc18d57fa52aca92dae"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "a49818199ea459e500b5ce64952691dc"
server_key_iv: "35cff8b976ddb4ab84813d7db548d197"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.603965 16375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:47.617251 16375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:47.620282 16375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:47.620494 16375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:47.621042 16375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:47.621837 16375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:47.621908 16375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.621979 16375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:47.622022 16375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.630558 16375 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:33663
I20260807 02:17:47.630631 16551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:33663 every 8 connection(s)
I20260807 02:17:47.631428 16375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:17:47.640151 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 16375
I20260807 02:17:47.640250 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:17:47.640574 1531 external_mini_cluster.cc:1428] Setting key 8eb23233b48e73cf2a9fe44ebf0cbbf6
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:47.645102 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:47.633435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:60907 (local address 127.1.126.254:38223)
0807 02:17:47.633575 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:47.633579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:47.634375 (+ 796us) server_negotiation.cc:407] Connection header received
0807 02:17:47.635862 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:47.635864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:47.635922 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:47.636015 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:47.637152 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.637745 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.638777 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.638986 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.639081 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:47.641542 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:47.641546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:47.641548 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:47.641571 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:47.643092 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:47.643583 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:47.643587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:47.643589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:47.643678 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:47.644022 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:47.644025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:47.644027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:47.644202 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:47.644358 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:47.644811 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 02:17:47.644927 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:47.645769 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:47.633777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38223 (local address 127.1.126.193:60907)
0807 02:17:47.634232 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:47.634272 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:47.635662 (+ 1390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:47.636177 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:47.636183 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:47.636504 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:47.637028 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:47.637041 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.637850 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.637853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:47.638655 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:47.638664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.639129 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.639132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:47.639275 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:47.639773 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:47.639788 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:47.641392 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:47.643213 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:47.643219 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:47.643232 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:47.643478 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:47.643774 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:47.643777 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:47.643779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:47.643920 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:47.644358 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:47.644364 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:47.644585 (+ 221us) client_negotiation.cc:769] Sending connection context
0807 02:17:47.644765 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 02:17:47.645051 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":115,"threads_started":1}
I20260807 02:17:47.646896 16552 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38223
I20260807 02:17:47.647131 16552 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:47.647578 16552 heartbeater.cc:511] Master 127.1.126.254:38223 requested a full tablet report, sending...
I20260807 02:17:47.649030 16278 ts_manager.cc:194] Registered new tserver with Master: 15b356c01c664cc18d57fa52aca92dae (127.1.126.193:33663)
I20260807 02:17:47.650117 16278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:60907
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:17:47.667863 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38223
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:47.779241 16557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:47.779470 16557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:47.779510 16557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:47.783730 16557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:47.783780 16557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:47.783834 16557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:17:47.788735 16557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:47.789601 16557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:47.790457 16557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:47.799975 16563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:47.799989 16568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:47.799989 16562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:47.800222 16557 server_base.cc:1034] running on GCE node
I20260807 02:17:47.800717 16557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:47.801298 16557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:47.802480 16557 hybrid_clock.cc:648] HybridClock initialized: now 1786069067802469 us; error 24 us; skew 500 ppm
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:47.805150 16557 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:17:47.805974 16557 webserver.cc:460] Webserver started at http://127.1.126.194:39721/ using document root <none> and password file <none>
I20260807 02:17:47.806574 16557 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:47.806664 16557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:47.806901 16557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:47.808952 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "4f72f906b68a44dc891856b8dd13af6f"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "a388398fb75e16113d7e26e560d29167"
server_key_iv: "eab88a7770bf5630791fc68faca23a13"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.809526 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "4f72f906b68a44dc891856b8dd13af6f"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "a388398fb75e16113d7e26e560d29167"
server_key_iv: "eab88a7770bf5630791fc68faca23a13"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.813087 16557 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:17:47.815390 16579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.816553 16557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:17:47.816690 16557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "4f72f906b68a44dc891856b8dd13af6f"
format_stamp: "Formatted at 2026-08-07 02:17:47 on dist-test-slave-39l8"
server_key: "a388398fb75e16113d7e26e560d29167"
server_key_iv: "eab88a7770bf5630791fc68faca23a13"
server_key_version: "encryptionkey@0"
I20260807 02:17:47.816794 16557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:47.827342 16557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:47.829929 16557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:47.830120 16557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:47.830684 16557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:47.831583 16557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:47.831651 16557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.831715 16557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:47.831758 16557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:47.840719 16557 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:46057
I20260807 02:17:47.840741 16742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:46057 every 8 connection(s)
I20260807 02:17:47.841569 16557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:17:47.843873 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 16557
I20260807 02:17:47.844002 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:17:47.844359 1531 external_mini_cluster.cc:1428] Setting key 89a213a59d743c3b17540ccf4af8bb4d
Aug 07 02:17:47 dist-test-slave-39l8 krb5kdc[16220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069067, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:17:47.856220 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:47.843264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:45421 (local address 127.1.126.254:38223)
0807 02:17:47.843404 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:47.843408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:47.844337 (+ 929us) server_negotiation.cc:407] Connection header received
0807 02:17:47.845966 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:47.845968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:47.846010 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:47.846078 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:47.847722 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.848270 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.849387 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.849614 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.849753 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:47.852578 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:47.852581 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:47.852583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:47.852607 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:47.854084 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:47.854613 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:47.854617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:47.854619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:47.854749 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:47.855110 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:47.855113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:47.855115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:47.855309 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:47.855419 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:47.855934 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 02:17:47.856054 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:47.857000 16748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:47.843623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38223 (local address 127.1.126.194:45421)
0807 02:17:47.844158 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:47.844219 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:47.845720 (+ 1501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:47.846299 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:47.846307 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:47.846861 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:47.847561 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:47.847582 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.848405 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.848408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:47.849258 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:47.849268 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:47.849787 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:47.849791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:47.850024 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:47.850624 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:47.850650 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:47.852396 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:47.854224 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:47.854230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:47.854243 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:47.854504 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:47.854860 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:47.854864 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:47.854866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:47.855007 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:47.855428 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:47.855437 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:47.855690 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 02:17:47.855889 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 02:17:47.856191 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
I20260807 02:17:47.858152 16745 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38223
I20260807 02:17:47.858422 16745 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:47.859035 16745 heartbeater.cc:511] Master 127.1.126.254:38223 requested a full tablet report, sending...
I20260807 02:17:47.860247 16278 ts_manager.cc:194] Registered new tserver with Master: 4f72f906b68a44dc891856b8dd13af6f (127.1.126.194:46057)
I20260807 02:17:47.860817 16278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:45421
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:17:47.873528 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38223
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:17:47.985376 16751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:17:47.985598 16751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:17:47.985637 16751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:17:47.989558 16751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:17:47.989609 16751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:17:47.989665 16751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:17:47.994657 16751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:38223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:17:47.995656 16751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:17:47.996611 16751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:17:48.006115 16764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:48.006129 16767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:17:48.006110 16762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:17:48.006486 16751 server_base.cc:1034] running on GCE node
I20260807 02:17:48.006953 16751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:17:48.007572 16751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:17:48.008735 16751 hybrid_clock.cc:648] HybridClock initialized: now 1786069068008704 us; error 43 us; skew 500 ppm
Aug 07 02:17:48 dist-test-slave-39l8 krb5kdc[16220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069068, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:17:48.011574 16751 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:17:48.012799 16751 webserver.cc:460] Webserver started at http://127.1.126.195:42411/ using document root <none> and password file <none>
I20260807 02:17:48.013617 16751 fs_manager.cc:359] Metadata directory not provided
I20260807 02:17:48.013720 16751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:17:48.013981 16751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:17:48.017005 16751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "ab4e0b705c154e5c8a2f46b8535c678d"
format_stamp: "Formatted at 2026-08-07 02:17:48 on dist-test-slave-39l8"
server_key: "992b869e1534a81d587681865b1e2dcd"
server_key_iv: "2655be1c98b50ebd7cecccbf06a8d662"
server_key_version: "encryptionkey@0"
I20260807 02:17:48.017715 16751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "ab4e0b705c154e5c8a2f46b8535c678d"
format_stamp: "Formatted at 2026-08-07 02:17:48 on dist-test-slave-39l8"
server_key: "992b869e1534a81d587681865b1e2dcd"
server_key_iv: "2655be1c98b50ebd7cecccbf06a8d662"
server_key_version: "encryptionkey@0"
I20260807 02:17:48.021776 16751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 02:17:48.024287 16776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:48.025481 16751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 02:17:48.025600 16751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "ab4e0b705c154e5c8a2f46b8535c678d"
format_stamp: "Formatted at 2026-08-07 02:17:48 on dist-test-slave-39l8"
server_key: "992b869e1534a81d587681865b1e2dcd"
server_key_iv: "2655be1c98b50ebd7cecccbf06a8d662"
server_key_version: "encryptionkey@0"
I20260807 02:17:48.025699 16751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:17:48.040561 16751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:17:48.043339 16751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:17:48.043529 16751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:17:48.044112 16751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:17:48.044917 16751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:17:48.044965 16751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:48.045032 16751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:17:48.045073 16751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:17:48.053872 16751 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:40493
I20260807 02:17:48.053916 16926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:40493 every 8 connection(s)
I20260807 02:17:48.054744 16751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:17:48.060186 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 16751
I20260807 02:17:48.060330 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:17:48.060612 1531 external_mini_cluster.cc:1428] Setting key b301acb43f1e8237725cabac713407e7
Aug 07 02:17:48 dist-test-slave-39l8 krb5kdc[16220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069068, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:17:48.068117 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.056470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:43651 (local address 127.1.126.254:38223)
0807 02:17:48.056616 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.056620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.057843 (+ 1223us) server_negotiation.cc:407] Connection header received
0807 02:17:48.058664 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.058667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.058768 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.058855 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:48.059983 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.060621 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.062077 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.062294 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.062404 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.064825 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:48.064829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:48.064831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:48.064862 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:48.066119 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:48.066605 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:48.066609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:48.066611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:48.066699 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:48.067088 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:48.067092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:48.067094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:48.067273 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:48.067383 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.067842 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.067956 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:17:48.068845 16931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.056813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:38223 (local address 127.1.126.195:43651)
0807 02:17:48.057696 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.057735 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:48.058475 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:48.059021 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:48.059027 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:48.059369 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:17:48.059823 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.059836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.060764 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.060779 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.061955 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.061965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.062440 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.062444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.062662 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.063248 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:17:48.063263 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:17:48.064667 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:17:48.066237 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:48.066243 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:48.066257 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:48.066501 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:48.066845 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:17:48.066849 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:17:48.066850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:17:48.066988 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:17:48.067382 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:17:48.067389 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:17:48.067617 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 02:17:48.067800 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 02:17:48.068089 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":556,"threads_started":1}
I20260807 02:17:48.069893 16927 heartbeater.cc:347] Connected to a master server at 127.1.126.254:38223
I20260807 02:17:48.070134 16927 heartbeater.cc:464] Registering TS with master...
I20260807 02:17:48.070609 16927 heartbeater.cc:511] Master 127.1.126.254:38223 requested a full tablet report, sending...
I20260807 02:17:48.071656 16278 ts_manager.cc:194] Registered new tserver with Master: ab4e0b705c154e5c8a2f46b8535c678d (127.1.126.195:40493)
I20260807 02:17:48.072248 16278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:43651
I20260807 02:17:48.074461 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:17:48.083468 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.076358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35466 (local address 127.1.126.254:38223)
0807 02:17:48.076452 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.076455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.076675 (+ 220us) server_negotiation.cc:407] Connection header received
0807 02:17:48.076764 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.076766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.076799 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.076861 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:17:48.077503 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.077971 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.078824 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.079026 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.079105 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.080304 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:17:48.080307 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:17:48.080309 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:17:48.080330 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:17:48.081844 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:48.082215 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:48.082218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:48.082219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:48.082293 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:17:48.082616 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:17:48.082618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:17:48.082619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:17:48.082894 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:17:48.083002 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.083211 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.083304 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 02:17:48.086144 16278 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35466:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:17:48.089087 16278 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:17:48.103359 16951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.097953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:40493 (local address 127.0.0.1:56610)
0807 02:17:48.098546 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.098559 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:48.098634 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:48.099324 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:48.099328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:48.099348 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:48.099479 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.099488 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.100943 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.100946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.102036 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.102044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.102916 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.102920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.102990 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.103010 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:17:48.103058 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 02:17:48.103216 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":24,"thread_start_us":89,"threads_started":1}
I20260807 02:17:48.103513 16944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.097230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:46057 (local address 127.0.0.1:47910)
0807 02:17:48.097592 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.097646 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:48.098023 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:48.099096 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:48.099102 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:48.099125 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:48.099277 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.099285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.100709 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.100712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.101924 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.101935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.103112 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.103116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.103216 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.103237 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:17:48.103316 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 02:17:48.103385 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260807 02:17:48.103555 16949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.097427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.1.126.194:46057)
0807 02:17:48.098573 (+ 1146us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.098586 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.098609 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:17:48.098762 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.098768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.098944 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.099102 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:48.099412 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.100566 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.102151 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.102975 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.103112 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.103263 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.103345 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.103429 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1029,"thread_start_us":166,"threads_started":1}
I20260807 02:17:48.103647 16953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.098377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56610 (local address 127.1.126.195:40493)
0807 02:17:48.098919 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.098930 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.098949 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:17:48.099017 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.099022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.099202 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.099338 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:48.099649 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.100811 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.102153 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.102783 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.103202 (+ 419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.103333 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.103385 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.103480 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":138,"threads_started":1}
I20260807 02:17:48.104096 16952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.098024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35688 (local address 127.1.126.193:33663)
0807 02:17:48.098403 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.098416 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.098606 (+ 190us) server_negotiation.cc:407] Connection header received
0807 02:17:48.098747 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.098754 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.098979 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.099121 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:48.099607 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.100316 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.101814 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.102613 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.102768 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.102919 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.103847 (+ 928us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.103944 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":104,"threads_started":1}
I20260807 02:17:48.104871 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.097582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33663 (local address 127.0.0.1:35688)
0807 02:17:48.098389 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.098404 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:48.098502 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:48.099290 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:48.099293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:48.099312 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:48.099465 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.099472 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.100447 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.100451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.101705 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.101717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.102776 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.102780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.102907 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.102953 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 02:17:48.103064 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 02:17:48.104746 (+ 1682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":74,"spinlock_wait_cycles":3840,"thread_start_us":104,"threads_started":1}
I20260807 02:17:48.106792 16655 tablet_service.cc:1467] Processing CreateTablet for tablet 853362f0db1f4421b94978e564d6cc65 (DEFAULT_TABLE table=test-table [id=89b3e301e5684b10bb5b8783fe72984d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:48.106799 16843 tablet_service.cc:1467] Processing CreateTablet for tablet 853362f0db1f4421b94978e564d6cc65 (DEFAULT_TABLE table=test-table [id=89b3e301e5684b10bb5b8783fe72984d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:48.107823 16655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853362f0db1f4421b94978e564d6cc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:48.107460 16452 tablet_service.cc:1467] Processing CreateTablet for tablet 853362f0db1f4421b94978e564d6cc65 (DEFAULT_TABLE table=test-table [id=89b3e301e5684b10bb5b8783fe72984d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:17:48.107882 16843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853362f0db1f4421b94978e564d6cc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:48.108371 16452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 853362f0db1f4421b94978e564d6cc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:17:48.114683 16954 tablet_bootstrap.cc:492] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Bootstrap starting.
I20260807 02:17:48.115257 16955 tablet_bootstrap.cc:492] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Bootstrap starting.
I20260807 02:17:48.115638 16956 tablet_bootstrap.cc:492] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: Bootstrap starting.
I20260807 02:17:48.117308 16956 tablet_bootstrap.cc:654] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:48.117560 16954 tablet_bootstrap.cc:654] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:48.117825 16955 tablet_bootstrap.cc:654] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Neither blocks nor log segments found. Creating new log.
I20260807 02:17:48.118449 16956 log.cc:824] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:48.118510 16954 log.cc:824] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:48.118510 16955 log.cc:824] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Log is configured to *not* fsync() on all Append() calls
I20260807 02:17:48.120487 16956 tablet_bootstrap.cc:492] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: No bootstrap required, opened a new log
I20260807 02:17:48.120510 16955 tablet_bootstrap.cc:492] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: No bootstrap required, opened a new log
I20260807 02:17:48.120707 16956 ts_tablet_manager.cc:1397] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 02:17:48.120733 16954 tablet_bootstrap.cc:492] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: No bootstrap required, opened a new log
I20260807 02:17:48.120783 16955 ts_tablet_manager.cc:1397] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:17:48.120913 16954 ts_tablet_manager.cc:1397] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260807 02:17:48.123522 16956 raft_consensus.cc:348] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.123764 16956 raft_consensus.cc:374] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:48.123838 16956 raft_consensus.cc:729] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15b356c01c664cc18d57fa52aca92dae, State: Initialized, Role: FOLLOWER
I20260807 02:17:48.124279 16956 consensus_queue.cc:260] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.124615 16954 raft_consensus.cc:348] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.124615 16955 raft_consensus.cc:348] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.124854 16955 raft_consensus.cc:374] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:48.124883 16552 heartbeater.cc:503] Master 127.1.126.254:38223 was elected leader, sending a full tablet report...
I20260807 02:17:48.124915 16954 raft_consensus.cc:374] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:17:48.124979 16955 raft_consensus.cc:729] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab4e0b705c154e5c8a2f46b8535c678d, State: Initialized, Role: FOLLOWER
I20260807 02:17:48.125026 16954 raft_consensus.cc:729] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f72f906b68a44dc891856b8dd13af6f, State: Initialized, Role: FOLLOWER
I20260807 02:17:48.125245 16956 ts_tablet_manager.cc:1428] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 02:17:48.125500 16954 consensus_queue.cc:260] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.125500 16955 consensus_queue.cc:260] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.126427 16955 ts_tablet_manager.cc:1428] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:17:48.126427 16954 ts_tablet_manager.cc:1428] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 02:17:48.126488 16927 heartbeater.cc:503] Master 127.1.126.254:38223 was elected leader, sending a full tablet report...
I20260807 02:17:48.126765 16745 heartbeater.cc:503] Master 127.1.126.254:38223 was elected leader, sending a full tablet report...
W20260807 02:17:48.132568 16553 tablet.cc:2369] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:17:48.305840 16930 tablet.cc:2369] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:17:48.343060 16747 tablet.cc:2369] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:17:48.348440 16963 raft_consensus.cc:482] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:17:48.348697 16963 raft_consensus.cc:504] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.349960 16963 leader_election.cc:288] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f72f906b68a44dc891856b8dd13af6f (127.1.126.194:46057), 15b356c01c664cc18d57fa52aca92dae (127.1.126.193:33663)
I20260807 02:17:48.355003 16949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.350436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:50287 (local address 127.1.126.194:46057)
0807 02:17:48.350581 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.350585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.350603 (+ 18us) server_negotiation.cc:407] Connection header received
0807 02:17:48.350696 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.350699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.350793 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.350875 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:48.351201 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.351995 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.353686 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.354270 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.354396 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.354448 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.354797 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.354868 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:48.355002 16952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.350348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:52141 (local address 127.1.126.193:33663)
0807 02:17:48.350487 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.350492 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.350897 (+ 405us) server_negotiation.cc:407] Connection header received
0807 02:17:48.350998 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.351000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.351044 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.351105 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:17:48.351376 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.352113 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.353683 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.354275 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.354396 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.354448 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.354797 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.354868 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 02:17:48.355043 16931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.350243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:46057 (local address 127.1.126.195:50287)
0807 02:17:48.350400 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.350419 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:48.350543 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:48.350895 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:48.350898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:48.350912 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:48.351060 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.351065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.352122 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.352125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.353546 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.353558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.354422 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.354426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.354615 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.354669 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 02:17:48.354770 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 02:17:48.354867 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":139}
I20260807 02:17:48.355082 16966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.350243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33663 (local address 127.1.126.195:52141)
0807 02:17:48.350786 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.350797 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:17:48.350904 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:17:48.351145 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:17:48.351151 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:17:48.351174 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:17:48.351271 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.351275 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.352219 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.352222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.353546 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:17:48.353558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.354422 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.354426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:17:48.354620 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.354661 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 02:17:48.354770 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 02:17:48.354867 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":272,"thread_start_us":149,"threads_started":1}
I20260807 02:17:48.355859 16483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853362f0db1f4421b94978e564d6cc65" candidate_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15b356c01c664cc18d57fa52aca92dae" is_pre_election: true
I20260807 02:17:48.355865 16682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853362f0db1f4421b94978e564d6cc65" candidate_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f72f906b68a44dc891856b8dd13af6f" is_pre_election: true
I20260807 02:17:48.356168 16483 raft_consensus.cc:2454] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab4e0b705c154e5c8a2f46b8535c678d in term 0.
I20260807 02:17:48.356154 16682 raft_consensus.cc:2454] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab4e0b705c154e5c8a2f46b8535c678d in term 0.
I20260807 02:17:48.356673 16777 leader_election.cc:302] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f72f906b68a44dc891856b8dd13af6f, ab4e0b705c154e5c8a2f46b8535c678d; no voters:
I20260807 02:17:48.356958 16963 raft_consensus.cc:2781] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:17:48.357067 16963 raft_consensus.cc:482] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:17:48.357128 16963 raft_consensus.cc:3037] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:48.358238 16963 raft_consensus.cc:504] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.358624 16963 leader_election.cc:288] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [CANDIDATE]: Term 1 election: Requested vote from peers 4f72f906b68a44dc891856b8dd13af6f (127.1.126.194:46057), 15b356c01c664cc18d57fa52aca92dae (127.1.126.193:33663)
I20260807 02:17:48.358973 16682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853362f0db1f4421b94978e564d6cc65" candidate_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f72f906b68a44dc891856b8dd13af6f"
I20260807 02:17:48.359028 16483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "853362f0db1f4421b94978e564d6cc65" candidate_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15b356c01c664cc18d57fa52aca92dae"
I20260807 02:17:48.359115 16682 raft_consensus.cc:3037] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:48.359148 16483 raft_consensus.cc:3037] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:17:48.360142 16682 raft_consensus.cc:2454] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab4e0b705c154e5c8a2f46b8535c678d in term 1.
I20260807 02:17:48.360369 16483 raft_consensus.cc:2454] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab4e0b705c154e5c8a2f46b8535c678d in term 1.
I20260807 02:17:48.360736 16780 leader_election.cc:302] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15b356c01c664cc18d57fa52aca92dae, ab4e0b705c154e5c8a2f46b8535c678d; no voters:
I20260807 02:17:48.361014 16963 raft_consensus.cc:2781] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:17:48.361248 16963 raft_consensus.cc:686] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 1 LEADER]: Becoming Leader. State: Replica: ab4e0b705c154e5c8a2f46b8535c678d, State: Running, Role: LEADER
I20260807 02:17:48.361634 16963 consensus_queue.cc:237] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } }
I20260807 02:17:48.365216 16278 catalog_manager.cc:5495] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d reported cstate change: term changed from 0 to 1, leader changed from <none> to ab4e0b705c154e5c8a2f46b8535c678d (127.1.126.195). New cstate: current_term: 1 leader_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab4e0b705c154e5c8a2f46b8535c678d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 40493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 } health_report { overall_health: UNKNOWN } } }
I20260807 02:17:48.395186 16953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.391495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56616 (local address 127.1.126.195:40493)
0807 02:17:48.391631 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:17:48.391637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:17:48.391651 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:17:48.391783 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:17:48.391785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:17:48.391842 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:17:48.391957 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:17:48.392239 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.392739 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.393620 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:17:48.393839 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:17:48.393952 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:17:48.394308 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:17:48.394749 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:17:48.394889 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 02:17:48.394950 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 02:17:48.395008 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:17:48.401230 16682 raft_consensus.cc:1261] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 1 FOLLOWER]: Refusing update from remote peer ab4e0b705c154e5c8a2f46b8535c678d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:48.401248 16483 raft_consensus.cc:1261] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae [term 1 FOLLOWER]: Refusing update from remote peer ab4e0b705c154e5c8a2f46b8535c678d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:17:48.401996 16963 consensus_queue.cc:1035] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [LEADER]: Connected to new peer: Peer: permanent_uuid: "15b356c01c664cc18d57fa52aca92dae" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:48.402269 16967 consensus_queue.cc:1035] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f72f906b68a44dc891856b8dd13af6f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:17:48.419443 16279 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:48.419623 16279 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:17:48.422215 16279 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59c879c16d884981a421a589711da265: Sending DeleteTablet for 3 replicas of tablet 853362f0db1f4421b94978e564d6cc65
I20260807 02:17:48.423166 16655 tablet_service.cc:1514] Processing DeleteTablet for tablet 853362f0db1f4421b94978e564d6cc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:48 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:47910
I20260807 02:17:48.423223 16452 tablet_service.cc:1514] Processing DeleteTablet for tablet 853362f0db1f4421b94978e564d6cc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:48 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:35688
I20260807 02:17:48.423676 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 16375
I20260807 02:17:48.423889 16987 tablet_replica.cc:330] T 853362f0db1f4421b94978e564d6cc65 P 15b356c01c664cc18d57fa52aca92dae: stopping tablet replica
I20260807 02:17:48.423868 16843 tablet_service.cc:1514] Processing DeleteTablet for tablet 853362f0db1f4421b94978e564d6cc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:17:48 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:56610
I20260807 02:17:48.426062 16986 tablet_replica.cc:330] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: stopping tablet replica
I20260807 02:17:48.426355 16986 raft_consensus.cc:2229] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:17:48.426697 16986 raft_consensus.cc:2258] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:48.429837 16986 ts_tablet_manager.cc:1905] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:48.433557 16986 ts_tablet_manager.cc:1918] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:48.433703 16986 log.cc:1196] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/853362f0db1f4421b94978e564d6cc65
I20260807 02:17:48.434057 16986 ts_tablet_manager.cc:1939] T 853362f0db1f4421b94978e564d6cc65 P 4f72f906b68a44dc891856b8dd13af6f: Deleting consensus metadata
I20260807 02:17:48.435556 16257 catalog_manager.cc:4841] TS 4f72f906b68a44dc891856b8dd13af6f (127.1.126.194:46057): tablet 853362f0db1f4421b94978e564d6cc65 (table test-table [id=89b3e301e5684b10bb5b8783fe72984d]) successfully deleted
I20260807 02:17:48.435781 16988 tablet_replica.cc:330] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: stopping tablet replica
I20260807 02:17:48.436095 16988 raft_consensus.cc:2229] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:17:48.436539 16988 raft_consensus.cc:2258] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:17:48.438151 16988 ts_tablet_manager.cc:1905] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:17:48.440790 16988 ts_tablet_manager.cc:1918] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:17:48.440894 16988 log.cc:1196] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/853362f0db1f4421b94978e564d6cc65
I20260807 02:17:48.441232 16988 ts_tablet_manager.cc:1939] T 853362f0db1f4421b94978e564d6cc65 P ab4e0b705c154e5c8a2f46b8535c678d: Deleting consensus metadata
W20260807 02:17:48.441717 16263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:33663 (error 108)
I20260807 02:17:48.442333 16257 catalog_manager.cc:4841] TS ab4e0b705c154e5c8a2f46b8535c678d (127.1.126.195:40493): tablet 853362f0db1f4421b94978e564d6cc65 (table test-table [id=89b3e301e5684b10bb5b8783fe72984d]) successfully deleted
I20260807 02:17:48.442963 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:17:48.442629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33663 (local address 127.0.0.1:35702)
0807 02:17:48.442782 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 02:17:48.442861 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 02:17:48.443147 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 16557
W20260807 02:17:48.450878 16263 catalog_manager.cc:4584] TS 15b356c01c664cc18d57fa52aca92dae (127.1.126.193:33663): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 853362f0db1f4421b94978e564d6cc65: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33663: connect: Connection refused (error 111)
I20260807 02:17:48.460028 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 16751
I20260807 02:17:48.469379 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 16238
2026-08-07T02:17:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2617 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:17:48 dist-test-slave-39l8 krb5kdc[16993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:17:48 dist-test-slave-39l8 krb5kdc[16993](info): set up 2 sockets
Aug 07 02:17:48 dist-test-slave-39l8 krb5kdc[16993](info): commencing operation
krb5kdc: starting...
W20260807 02:17:49.667493 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:17:49 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:17:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:17:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/rangeradmin_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/rangeradmin_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/rangerlookup_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/rangerlookup_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
I20260807 02:17:49.837001 1531 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskd_5Q2x/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/postgres -l logfile start
2026-08-07 02:17:52.181 UTC [17037] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 02:17:52.182 UTC [17037] LOG: listening on IPv4 address "127.1.126.212", port 53471
2026-08-07 02:17:52.185 UTC [17037] LOG: listening on Unix socket "/tmp/.s.PGSQL.53471"
2026-08-07 02:17:52.224 UTC [17040] LOG: database system was shut down at 2026-08-07 02:17:50 UTC
2026-08-07 02:17:52.228 UTC [17037] LOG: database system is ready to accept connections
I20260807 02:17:53.365105 1531 mini_postgres.cc:96] Postgres bound to 53471
2026-08-07 02:17:53.373 UTC [17048] FATAL: database "slave" does not exist
127.1.126.212:53471 - accepting connections
I20260807 02:17:53.374253 1531 mini_ranger.cc:161] Starting Ranger...
I20260807 02:17:53.390496 1531 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 02:17:53.782958 1531 mini_ranger.cc:87] Created ranger Postgres database
I20260807 02:17:53.783066 1531 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-admin
2026-08-07 02:17:54,105 [I] DB FLAVOR :POSTGRES
2026-08-07 02:17:54,106 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 02:17:54,106 [I] Checking connection..
2026-08-07 02:17:54,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 02:17:54,344 [I] Checking connection passed.
2026-08-07 02:17:54,344 [I] --------- Verifying version history table ---------
2026-08-07 02:17:54,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 02:17:54,617 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 02:17:54,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 02:17:54,881 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 02:17:54,881 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 02:17:54,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 02:17:55.131 UTC [17133] WARNING: there is no transaction in progress
2026-08-07 02:17:55,140 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 02:17:55,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 02:17:55,406 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 02:17:55,406 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 02:17:55,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 02:17:55,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 02:17:55,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-39l8.c.gcp-upstream.internal','N') ;"
2026-08-07 02:17:56,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 02:17:56,444 [I] Table x_portal_user does not exist in database ranger
2026-08-07 02:17:56,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 02:17:56,678 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 02:17:56,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 02:17:56,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 02:17:57,168 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 02:17:57,168 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 02:17:58.086 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.101 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.116 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.131 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.145 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.160 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.212 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.218 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.231 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.241 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.251 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.264 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.273 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.279 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.285 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58.291 UTC [17272] WARNING: there is no transaction in progress
2026-08-07 02:17:58,845 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 02:17:58,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 02:17:59,067 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 02:17:59,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 02:17:59,330 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 02:17:59,331 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 02:17:59,570 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 02:17:59,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 02:17:59,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 02:18:00,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-39l8.c.gcp-upstream.internal';"
2026-08-07 02:18:00,340 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 02:18:00,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 02:18:00,580 [I] DB_PATCHES have already been applied
I20260807 02:18:00.586437 1531 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-admin:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskd_5Q2x/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 02:18:00.586522 1531 mini_ranger.cc:193] Using host: 127.1.126.212
I20260807 02:18:00.591238 1531 mini_ranger.cc:227] Ranger admin URL: http://127.1.126.212:38893
Aug 07, 2026 2:18:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 2:18:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 2:18:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 2:18:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 2:18:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 2:18:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 2:18:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 02:18:01.920258 1531 mini_ranger.cc:160] Time spent starting Ranger: real 8.546s user 0.004s sys 0.008s
Aug 07, 2026 2:18:21 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 2:18:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 2:18:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 2:18:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 2:18:22 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 02:18:23.573150 1531 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/rangerkms_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/rangerkms_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.126.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.126.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 02:18:23 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069103, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 02:18:23.675011 1531 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 02:18:23.685686 1531 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 02:18:24.454877 1531 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 02:18:24.454984 1531 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms
I20260807 02:18:24.455111 1531 mini_ranger_kms.cc:227] Using postgres at 127.1.126.212:53471
2026-08-07 02:18:24,744 [I] DB FLAVOR :POSTGRES
2026-08-07 02:18:24,744 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 02:18:24,744 [I] Checking connection
2026-08-07 02:18:24,745 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 02:18:25,064 [I] connection success
2026-08-07 02:18:25,065 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 02:18:25,065 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 02:18:25,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 02:18:25,381 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 02:18:25,382 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 02:18:25,382 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 02:18:25,382 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:53471/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 02:18:25,687 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 02:18:26.143388 1531 mini_ranger_kms.cc:310] Created kms service
I20260807 02:18:26.355472 1531 mini_ranger_kms.cc:326] Created kudu user
I20260807 02:18:26.398329 1531 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 02:18:26 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069103, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:18:26.791225 1531 mini_ranger_kms.cc:384] Added ranger policy
I20260807 02:18:26.791385 1531 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms:/tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 02:18:26.791407 1531 mini_ranger_kms.cc:240] Using host: 127.1.126.212
I20260807 02:18:26.797142 1531 mini_ranger_kms.cc:276] Ranger KMS PID: 17509
I20260807 02:18:26.797286 1531 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.126.212:43801
Aug 07, 2026 2:18:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 2:18:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 2:18:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 2:18:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 2:18:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 2:18:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 02:18:29 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786069109, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.126.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:18:29.409173 1531 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.734s user 0.019s sys 0.241s
I20260807 02:18:29.409336 1531 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 02:18:29.409477 1531 mini_ranger_kms.cc:401] 127.1.126.212:43801/kms/v1/keys
Aug 07 02:18:29 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069109, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.126.212@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
Aug 07 02:18:29 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069109, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.126.212@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
Aug 07 02:18:32 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:18:32.265687 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42953
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:42953
--ranger_config_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:43801/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:18:32.382477 17576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:18:32.382735 17576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:18:32.382829 17576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:18:32.386679 17576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:18:32.386785 17576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:18:32.386843 17576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:18:32.386873 17576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:18:32.386904 17576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:18:32.392192 17576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.126.212:43801/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:42953
--ranger_config_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:18:32.393184 17576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:18:32.394210 17576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:18:32.402979 17583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:32.403163 17582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:18:32.403131 17576 server_base.cc:1034] running on GCE node
W20260807 02:18:32.403040 17587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:18:32.403929 17576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:18:32.404937 17576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:18:32.406136 17576 hybrid_clock.cc:648] HybridClock initialized: now 1786069112406110 us; error 37 us; skew 500 ppm
Aug 07 02:18:32 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069112, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:18:32.414040 17576 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:18:32.414945 17576 webserver.cc:460] Webserver started at http://127.1.126.254:35735/ using document root <none> and password file <none>
I20260807 02:18:32.415520 17576 fs_manager.cc:359] Metadata directory not provided
I20260807 02:18:32.415601 17576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:18:32.415839 17576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:18:32 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069112, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:18:32.469318 17576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "cf3ed9f8d48c4e10a00bc443297d4405"
format_stamp: "Formatted at 2026-08-07 02:18:32 on dist-test-slave-39l8"
server_key: "78518cd3f278cf33bb4cdae7e9b4cc09"
server_key_iv: "27cb0bfcfbb3244c1b8f7e34020baa38"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:32.469954 17576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "cf3ed9f8d48c4e10a00bc443297d4405"
format_stamp: "Formatted at 2026-08-07 02:18:32 on dist-test-slave-39l8"
server_key: "78518cd3f278cf33bb4cdae7e9b4cc09"
server_key_iv: "27cb0bfcfbb3244c1b8f7e34020baa38"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:32.474858 17576 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 02:18:32.490212 17597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:32.491731 17576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:18:32.491909 17576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "cf3ed9f8d48c4e10a00bc443297d4405"
format_stamp: "Formatted at 2026-08-07 02:18:32 on dist-test-slave-39l8"
server_key: "78518cd3f278cf33bb4cdae7e9b4cc09"
server_key_iv: "27cb0bfcfbb3244c1b8f7e34020baa38"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:32.492069 17576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:18:32.508970 17576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:18:32.512220 17576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:18:32.512455 17576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:18:32.521868 17576 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:42953
I20260807 02:18:32.521880 17674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:42953 every 8 connection(s)
I20260807 02:18:32.522946 17576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:18:32.525782 17675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:18:32.531780 17675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405: Bootstrap starting.
I20260807 02:18:32.533059 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 17576
I20260807 02:18:32.533231 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:18:32.533525 1531 external_mini_cluster.cc:1428] Setting key 527ba6f9d852e5199166f0cdc39ee623
I20260807 02:18:32.534899 17675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405: Neither blocks nor log segments found. Creating new log.
I20260807 02:18:32.535665 17675 log.cc:824] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405: Log is configured to *not* fsync() on all Append() calls
I20260807 02:18:32.537878 17675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405: No bootstrap required, opened a new log
Aug 07 02:18:32 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:18:32.542541 17675 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42953 } }
I20260807 02:18:32.542867 17675 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:18:32.542953 17675 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3ed9f8d48c4e10a00bc443297d4405, State: Initialized, Role: FOLLOWER
I20260807 02:18:32.543493 17675 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42953 } }
I20260807 02:18:32.543687 17675 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:18:32.543762 17675 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:18:32.543870 17675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:18:32.544739 17675 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42953 } }
I20260807 02:18:32.545102 17675 leader_election.cc:302] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf3ed9f8d48c4e10a00bc443297d4405; no voters:
I20260807 02:18:32.545562 17675 leader_election.cc:288] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:18:32.545657 17682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:18:32.545924 17682 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [term 1 LEADER]: Becoming Leader. State: Replica: cf3ed9f8d48c4e10a00bc443297d4405, State: Running, Role: LEADER
I20260807 02:18:32.546319 17682 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42953 } }
I20260807 02:18:32.547068 17675 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:18:32.548750 17678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:32.534777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37472 (local address 127.1.126.254:42953)
0807 02:18:32.535250 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:32.535266 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:32.535301 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:18:32.535954 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:32.535973 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:32.536294 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:32.536561 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:18:32.537471 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:32.538539 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:32.539757 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:32.540208 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:32.540322 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:32.543174 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:18:32.543181 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:18:32.543199 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:18:32.543234 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:18:32.545102 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:32.545748 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:32.545760 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:32.545767 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:32.545912 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:32.546279 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:32.546282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:32.546283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:32.546806 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:18:32.547012 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:32.547347 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 02:18:32.547648 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":142,"threads_started":1}
I20260807 02:18:32.549773 17675 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 02:18:32.549861 17685 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42953 } } }
I20260807 02:18:32.549993 17685 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [sys.catalog]: This master's current role is: LEADER
I20260807 02:18:32.550390 17707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:18:32.550830 17684 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf3ed9f8d48c4e10a00bc443297d4405. Latest consensus state: current_term: 1 leader_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3ed9f8d48c4e10a00bc443297d4405" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42953 } } }
I20260807 02:18:32.551002 17684 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405 [sys.catalog]: This master's current role is: LEADER
I20260807 02:18:32.557300 17707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:18:32.565129 17707 catalog_manager.cc:1347] Generated new cluster ID: e09e03e9b57046ef95eee4dca685c096
I20260807 02:18:32.565192 17707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:18:32.587903 17707 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:18:32.589322 17707 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:18:32.600189 17707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405: Generated new TSK 0
I20260807 02:18:32.601014 17707 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:18:33.267614 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:43801/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42953
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:18:33.390429 17738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:18:33.390655 17738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:18:33.390694 17738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:18:33.396174 17738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:18:33.396250 17738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:18:33.396332 17738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:18:33.404963 17738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.126.212:43801/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:18:33.406312 17738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:18:33.407753 17738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:18:33.419296 17744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:33.419346 17745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:33.419575 17747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:18:33.419660 17738 server_base.cc:1034] running on GCE node
I20260807 02:18:33.420042 17738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:18:33.420624 17738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:18:33.421826 17738 hybrid_clock.cc:648] HybridClock initialized: now 1786069113421762 us; error 81 us; skew 500 ppm
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:18:33.424783 17738 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:18:33.425781 17738 webserver.cc:460] Webserver started at http://127.1.126.193:45617/ using document root <none> and password file <none>
I20260807 02:18:33.426417 17738 fs_manager.cc:359] Metadata directory not provided
I20260807 02:18:33.426501 17738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:18:33.426749 17738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:18:33.441952 17738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "5502a2e235354db5b3f739ba649c6b39"
format_stamp: "Formatted at 2026-08-07 02:18:33 on dist-test-slave-39l8"
server_key: "5a8a4c490e6ee5f9bee7962d83944b77"
server_key_iv: "aac4fae77adfcdc44f5ce81284b62196"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:33.442559 17738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "5502a2e235354db5b3f739ba649c6b39"
format_stamp: "Formatted at 2026-08-07 02:18:33 on dist-test-slave-39l8"
server_key: "5a8a4c490e6ee5f9bee7962d83944b77"
server_key_iv: "aac4fae77adfcdc44f5ce81284b62196"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:33.446504 17738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260807 02:18:33.463467 17756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:33.465050 17738 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 02:18:33.465179 17738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "5502a2e235354db5b3f739ba649c6b39"
format_stamp: "Formatted at 2026-08-07 02:18:33 on dist-test-slave-39l8"
server_key: "5a8a4c490e6ee5f9bee7962d83944b77"
server_key_iv: "aac4fae77adfcdc44f5ce81284b62196"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:33.465303 17738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:18:33.492802 17738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:18:33.496232 17738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:18:33.496491 17738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:18:33.497182 17738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:18:33.498306 17738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:18:33.498404 17738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:33.498490 17738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:18:33.498543 17738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:33.511127 17738 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:43897
I20260807 02:18:33.512274 17738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:18:33.513912 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 17738
I20260807 02:18:33.514045 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:18:33.514348 1531 external_mini_cluster.cc:1428] Setting key 70a066632444cfd394cdbc07a9be615d
I20260807 02:18:33.513688 17909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:43897 every 8 connection(s)
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:18:33.531342 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:33.515803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:36709 (local address 127.1.126.254:42953)
0807 02:18:33.516420 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:33.516430 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:33.517048 (+ 618us) server_negotiation.cc:407] Connection header received
0807 02:18:33.518293 (+ 1245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:33.518297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:33.518349 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:33.518410 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:18:33.520024 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.521625 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.523597 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.523950 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.524030 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:33.527130 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:18:33.527136 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:18:33.527142 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:18:33.527175 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:18:33.529089 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:33.529673 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:33.529677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:33.529679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:33.529775 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:33.530142 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:33.530145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:33.530147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:33.530347 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:18:33.530428 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:33.531060 (+ 632us) server_negotiation.cc:299] Negotiation successful
0807 02:18:33.531178 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":88,"threads_started":1}
I20260807 02:18:33.532980 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:33.516326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42953 (local address 127.1.126.193:36709)
0807 02:18:33.516898 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:33.516952 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:33.518044 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:33.518839 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:33.518848 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:33.519220 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:18:33.519860 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:33.519878 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.521793 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.521796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:33.523444 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:33.523456 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.524235 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.524238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:33.524432 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:33.525060 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:18:33.525085 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:18:33.526947 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:18:33.529233 (+ 2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:18:33.529238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:18:33.529253 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:18:33.529562 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:18:33.529880 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:18:33.529883 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:18:33.529885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:18:33.530046 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:18:33.530493 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:18:33.530498 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:18:33.530801 (+ 303us) client_negotiation.cc:769] Sending connection context
0807 02:18:33.531743 (+ 942us) client_negotiation.cc:240] Negotiation successful
0807 02:18:33.532071 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":155,"threads_started":1}
I20260807 02:18:33.534673 17910 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42953
I20260807 02:18:33.534946 17910 heartbeater.cc:464] Registering TS with master...
I20260807 02:18:33.535490 17910 heartbeater.cc:511] Master 127.1.126.254:42953 requested a full tablet report, sending...
I20260807 02:18:33.537190 17626 ts_manager.cc:194] Registered new tserver with Master: 5502a2e235354db5b3f739ba649c6b39 (127.1.126.193:43897)
I20260807 02:18:33.538635 17626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:36709
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:18:33.565734 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:43801/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42953
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 02:18:33.731319 17918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:18:33.731631 17918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:18:33.731691 17918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:18:33.737175 17918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:18:33.737257 17918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:18:33.737331 17918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:18:33.744478 17918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.126.212:43801/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:18:33.745669 17918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:18:33.747009 17918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:18:33.757885 17932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:33.759079 17928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:33.759322 17929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:18:33.759433 17918 server_base.cc:1034] running on GCE node
I20260807 02:18:33.760006 17918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:18:33.760767 17918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:18:33.761933 17918 hybrid_clock.cc:648] HybridClock initialized: now 1786069113761910 us; error 56 us; skew 500 ppm
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:18:33.765432 17918 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:18:33.766495 17918 webserver.cc:460] Webserver started at http://127.1.126.194:39917/ using document root <none> and password file <none>
I20260807 02:18:33.767217 17918 fs_manager.cc:359] Metadata directory not provided
I20260807 02:18:33.767299 17918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:18:33.767509 17918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:18:33.783488 17918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "1b41312f1c84406faa765118de997692"
format_stamp: "Formatted at 2026-08-07 02:18:33 on dist-test-slave-39l8"
server_key: "c1dcae8710736008cc7b46e38279ca8b"
server_key_iv: "d200643eb6d5db73a58b2d0f8f49c9a0"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:33.784130 17918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "1b41312f1c84406faa765118de997692"
format_stamp: "Formatted at 2026-08-07 02:18:33 on dist-test-slave-39l8"
server_key: "c1dcae8710736008cc7b46e38279ca8b"
server_key_iv: "d200643eb6d5db73a58b2d0f8f49c9a0"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:33.789013 17918 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 02:18:33.823067 17944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:33.824824 17918 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.003s sys 0.001s
I20260807 02:18:33.824956 17918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "1b41312f1c84406faa765118de997692"
format_stamp: "Formatted at 2026-08-07 02:18:33 on dist-test-slave-39l8"
server_key: "c1dcae8710736008cc7b46e38279ca8b"
server_key_iv: "d200643eb6d5db73a58b2d0f8f49c9a0"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:33.825084 17918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:18:33.880189 17918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:18:33.885059 17918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:18:33.885300 17918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:18:33.886022 17918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:18:33.887153 17918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:18:33.887262 17918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:33.887341 17918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:18:33.887383 17918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:33.899176 17918 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:45163
I20260807 02:18:33.899252 18114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:45163 every 8 connection(s)
I20260807 02:18:33.900324 17918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:18:33.902997 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 17918
I20260807 02:18:33.903144 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:18:33.903461 1531 external_mini_cluster.cc:1428] Setting key ebf684ad3a594a22e6516cc9a853e0a1
Aug 07 02:18:33 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
I20260807 02:18:33.924396 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:33.902461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:45181 (local address 127.1.126.254:42953)
0807 02:18:33.902622 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:33.902627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:33.911205 (+ 8578us) server_negotiation.cc:407] Connection header received
0807 02:18:33.912303 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:33.912308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:33.912362 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:33.912462 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:18:33.913989 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.914777 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.916655 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.916981 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.917085 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:33.920393 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:18:33.920397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:18:33.920400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:18:33.920428 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:18:33.922282 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:33.922850 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:33.922853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:33.922855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:33.922945 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:33.923294 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:33.923297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:33.923299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:33.923481 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:18:33.923591 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:33.924075 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 02:18:33.924226 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:18:33.925097 18119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:33.902944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42953 (local address 127.1.126.194:45181)
0807 02:18:33.911030 (+ 8086us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:33.911087 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:33.912085 (+ 998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:33.912697 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:33.912709 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:33.913100 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:18:33.913810 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:33.913834 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.914928 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.914934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:33.916504 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:33.916520 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:33.917255 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:33.917259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:33.917453 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:33.918205 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:18:33.918229 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:18:33.920207 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:18:33.922414 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:18:33.922418 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:18:33.922430 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:18:33.922748 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:18:33.923036 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:18:33.923040 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:18:33.923041 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:18:33.923175 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:18:33.923590 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:18:33.923597 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:18:33.923839 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 02:18:33.924017 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 02:18:33.924320 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7858,"thread_start_us":147,"threads_started":1}
I20260807 02:18:33.926677 18116 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42953
I20260807 02:18:33.926957 18116 heartbeater.cc:464] Registering TS with master...
I20260807 02:18:33.927525 18116 heartbeater.cc:511] Master 127.1.126.254:42953 requested a full tablet report, sending...
I20260807 02:18:33.928743 17626 ts_manager.cc:194] Registered new tserver with Master: 1b41312f1c84406faa765118de997692 (127.1.126.194:45163)
I20260807 02:18:33.929338 17626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:45181
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:18:33.943673 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:43801/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42953
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:18:34 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
W20260807 02:18:34.106540 18122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:18:34.107225 18122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:18:34.107309 18122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:18:34.113171 18122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:18:34.113358 18122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:18:34.113479 18122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:18:34.119022 18122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.126.212:43801/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:18:34.120726 18122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:18:34.122061 18122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:18:34.135605 18136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:34.136327 18127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:18:34.137169 18130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:18:34.137624 18122 server_base.cc:1034] running on GCE node
I20260807 02:18:34.138072 18122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:18:34.138888 18122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:18:34.140049 18122 hybrid_clock.cc:648] HybridClock initialized: now 1786069114139991 us; error 86 us; skew 500 ppm
Aug 07 02:18:34 dist-test-slave-39l8 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069114, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:18:34.143923 18122 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:18:34.144992 18122 webserver.cc:460] Webserver started at http://127.1.126.195:43657/ using document root <none> and password file <none>
I20260807 02:18:34.145696 18122 fs_manager.cc:359] Metadata directory not provided
I20260807 02:18:34.145785 18122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:18:34.146010 18122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:18:34 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069114, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:18:34.162338 18122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3"
format_stamp: "Formatted at 2026-08-07 02:18:34 on dist-test-slave-39l8"
server_key: "0ed6bce058225a1ecbd091427ac15b2a"
server_key_iv: "81b18aa0822eabc6c4cde2f7583ea3f9"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:34.163143 18122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3"
format_stamp: "Formatted at 2026-08-07 02:18:34 on dist-test-slave-39l8"
server_key: "0ed6bce058225a1ecbd091427ac15b2a"
server_key_iv: "81b18aa0822eabc6c4cde2f7583ea3f9"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:34.171236 18122 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260807 02:18:34.194231 18145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:34.196134 18122 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.000s
I20260807 02:18:34.196282 18122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3"
format_stamp: "Formatted at 2026-08-07 02:18:34 on dist-test-slave-39l8"
server_key: "0ed6bce058225a1ecbd091427ac15b2a"
server_key_iv: "81b18aa0822eabc6c4cde2f7583ea3f9"
server_key_version: "kuduclusterkey@0"
I20260807 02:18:34.196434 18122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:18:34.217649 18122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:18:34.220950 18122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:18:34.221158 18122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:18:34.221745 18122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:18:34.222569 18122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:18:34.222656 18122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:34.222777 18122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:18:34.222824 18122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:18:34.233850 18122 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:37333
I20260807 02:18:34.234052 18306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:37333 every 8 connection(s)
I20260807 02:18:34.235087 18122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:18:34.236315 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 18122
I20260807 02:18:34.236461 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:18:34.236891 1531 external_mini_cluster.cc:1428] Setting key 24fc96ca72087034e1fabb6850eb7100
Aug 07 02:18:34 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069114, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:18:34.253648 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.238730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:56063 (local address 127.1.126.254:42953)
0807 02:18:34.238849 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.238854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.240057 (+ 1203us) server_negotiation.cc:407] Connection header received
0807 02:18:34.241254 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.241258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.241311 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.241400 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:18:34.242844 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.243646 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.245347 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.245736 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.245839 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.248853 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:18:34.248858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:18:34.248861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:18:34.248888 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:18:34.251071 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:34.251768 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:34.251773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:34.251774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:34.251872 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:34.252333 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:34.252337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:34.252339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:34.252590 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:18:34.252710 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.253365 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.253487 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 02:18:34.254689 18310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.239251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42953 (local address 127.1.126.195:56063)
0807 02:18:34.239914 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.239967 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:34.241015 (+ 1048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:34.241591 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:34.241601 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:34.242025 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:18:34.242673 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.242691 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.243796 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.243799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.245198 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.245210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.245908 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.245912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.246123 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.246864 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:18:34.246885 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:18:34.248659 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:18:34.251228 (+ 2569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:18:34.251234 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:18:34.251250 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:18:34.251625 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:18:34.251975 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:18:34.251978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:18:34.251980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:18:34.252197 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:18:34.252724 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:18:34.252731 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:18:34.253046 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 02:18:34.253257 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 02:18:34.253600 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":150,"threads_started":1}
I20260807 02:18:34.255942 18308 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42953
I20260807 02:18:34.256217 18308 heartbeater.cc:464] Registering TS with master...
I20260807 02:18:34.256815 18308 heartbeater.cc:511] Master 127.1.126.254:42953 requested a full tablet report, sending...
I20260807 02:18:34.258071 17626 ts_manager.cc:194] Registered new tserver with Master: 3d99dd0cd90f4fe9bc62e6b4017e3aa3 (127.1.126.195:37333)
I20260807 02:18:34.258931 17626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:56063
I20260807 02:18:34.262910 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:18:34.275161 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.265248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37474 (local address 127.1.126.254:42953)
0807 02:18:34.265348 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.265353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.265730 (+ 377us) server_negotiation.cc:407] Connection header received
0807 02:18:34.265943 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.265947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.265991 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.266039 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:18:34.267247 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.268010 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.269242 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.269556 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.269644 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.271463 (+ 1819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:18:34.271467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:18:34.271469 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:18:34.271495 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:18:34.273236 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:34.273778 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:34.273782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:34.273783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:34.273869 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:18:34.274190 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:18:34.274193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:18:34.274195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:18:34.274419 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:18:34.274527 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.274916 (+ 389us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.275020 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 02:18:34.279214 17626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:18:34.283901 17626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:18:34.303489 18326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.294263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:43897 (local address 127.0.0.1:35590)
0807 02:18:34.296523 (+ 2260us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.296555 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:34.297447 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:34.298085 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:34.298088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:34.298105 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:18:34.298187 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.298192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.299576 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.299579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.301723 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.301734 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.303000 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.303005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.303133 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.303166 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 02:18:34.303260 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 02:18:34.303357 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2169,"thread_start_us":115,"threads_started":1}
I20260807 02:18:34.304610 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.294822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35590 (local address 127.1.126.193:43897)
0807 02:18:34.295688 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.295694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.297374 (+ 1680us) server_negotiation.cc:407] Connection header received
0807 02:18:34.297587 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.297593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.297786 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.297910 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:18:34.298306 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.299437 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.301897 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.302667 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.302770 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.302897 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.304399 (+ 1502us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.304489 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":121,"threads_started":1}
I20260807 02:18:34.305963 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.294842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59874 (local address 127.1.126.195:37333)
0807 02:18:34.295465 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.295496 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.296156 (+ 660us) server_negotiation.cc:407] Connection header received
0807 02:18:34.296407 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.296414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.296725 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.296894 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:18:34.297427 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.298667 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.300474 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.301279 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.301362 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.301514 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.305754 (+ 4240us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.305840 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":167,"threads_started":1}
I20260807 02:18:34.306280 18329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.294161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:37333 (local address 127.0.0.1:59874)
0807 02:18:34.296016 (+ 1855us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.296071 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:34.296205 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:34.297120 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:34.297127 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:34.297152 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:18:34.297287 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.297296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.298859 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.298863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.300302 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.300313 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.304907 (+ 4594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.304910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.305603 (+ 693us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.305625 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 02:18:34.306097 (+ 472us) client_negotiation.cc:240] Negotiation successful
0807 02:18:34.306164 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1656,"mutex_wait_us":593,"thread_start_us":109,"threads_started":1}
I20260807 02:18:34.308038 17821 tablet_service.cc:1467] Processing CreateTablet for tablet 069e1883810f42f1acb5fde7f31741c4 (DEFAULT_TABLE table=test-table [id=c04707487385479b932171ee45e9f382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:18:34.309226 17821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069e1883810f42f1acb5fde7f31741c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:18:34.308877 18212 tablet_service.cc:1467] Processing CreateTablet for tablet 069e1883810f42f1acb5fde7f31741c4 (DEFAULT_TABLE table=test-table [id=c04707487385479b932171ee45e9f382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:18:34.309513 18325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.295426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:45163 (local address 127.0.0.1:46140)
0807 02:18:34.300683 (+ 5257us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.300695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:34.300805 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:34.302182 (+ 1377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:34.302186 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:34.302205 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:18:34.302290 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.302297 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.304242 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.304245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.306763 (+ 2518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.306794 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.309070 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.309078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.309216 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.309243 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:18:34.309321 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 02:18:34.309385 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5198,"thread_start_us":83,"threads_started":1}
I20260807 02:18:34.309832 18212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069e1883810f42f1acb5fde7f31741c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:18:34.309933 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.295568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46140 (local address 127.1.126.194:45163)
0807 02:18:34.296041 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.296053 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.301568 (+ 5515us) server_negotiation.cc:407] Connection header received
0807 02:18:34.301661 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.301666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.301862 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.302036 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:18:34.302435 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.303549 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.306974 (+ 3425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.307904 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.308008 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.308164 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.309685 (+ 1521us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.309783 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":155,"threads_started":1}
I20260807 02:18:34.312707 18009 tablet_service.cc:1467] Processing CreateTablet for tablet 069e1883810f42f1acb5fde7f31741c4 (DEFAULT_TABLE table=test-table [id=c04707487385479b932171ee45e9f382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:18:34.313686 18009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069e1883810f42f1acb5fde7f31741c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:18:34.318626 18332 tablet_bootstrap.cc:492] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Bootstrap starting.
I20260807 02:18:34.321486 18332 tablet_bootstrap.cc:654] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Neither blocks nor log segments found. Creating new log.
I20260807 02:18:34.322405 18332 log.cc:824] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Log is configured to *not* fsync() on all Append() calls
I20260807 02:18:34.324569 18332 tablet_bootstrap.cc:492] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: No bootstrap required, opened a new log
I20260807 02:18:34.324761 18332 ts_tablet_manager.cc:1397] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.003s
I20260807 02:18:34.328806 18335 tablet_bootstrap.cc:492] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: Bootstrap starting.
I20260807 02:18:34.328841 18332 raft_consensus.cc:348] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.329242 18332 raft_consensus.cc:374] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:18:34.329361 18332 raft_consensus.cc:729] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d99dd0cd90f4fe9bc62e6b4017e3aa3, State: Initialized, Role: FOLLOWER
I20260807 02:18:34.329912 18332 consensus_queue.cc:260] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.330554 18333 tablet_bootstrap.cc:492] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Bootstrap starting.
I20260807 02:18:34.331166 18332 ts_tablet_manager.cc:1428] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 02:18:34.331606 18308 heartbeater.cc:503] Master 127.1.126.254:42953 was elected leader, sending a full tablet report...
I20260807 02:18:34.332872 18335 tablet_bootstrap.cc:654] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: Neither blocks nor log segments found. Creating new log.
I20260807 02:18:34.333838 18335 log.cc:824] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: Log is configured to *not* fsync() on all Append() calls
I20260807 02:18:34.336180 18333 tablet_bootstrap.cc:654] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Neither blocks nor log segments found. Creating new log.
I20260807 02:18:34.337196 18333 log.cc:824] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Log is configured to *not* fsync() on all Append() calls
I20260807 02:18:34.339656 18335 tablet_bootstrap.cc:492] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: No bootstrap required, opened a new log
I20260807 02:18:34.339920 18335 ts_tablet_manager.cc:1397] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 02:18:34.343668 18335 raft_consensus.cc:348] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.343997 18335 raft_consensus.cc:374] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:18:34.344115 18335 raft_consensus.cc:729] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5502a2e235354db5b3f739ba649c6b39, State: Initialized, Role: FOLLOWER
I20260807 02:18:34.344687 18335 consensus_queue.cc:260] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.346212 18333 tablet_bootstrap.cc:492] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: No bootstrap required, opened a new log
I20260807 02:18:34.346395 18333 ts_tablet_manager.cc:1397] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260807 02:18:34.347604 18335 ts_tablet_manager.cc:1428] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 02:18:34.347982 17910 heartbeater.cc:503] Master 127.1.126.254:42953 was elected leader, sending a full tablet report...
I20260807 02:18:34.351019 18333 raft_consensus.cc:348] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.351325 18333 raft_consensus.cc:374] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:18:34.351428 18333 raft_consensus.cc:729] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b41312f1c84406faa765118de997692, State: Initialized, Role: FOLLOWER
I20260807 02:18:34.352965 18333 consensus_queue.cc:260] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.353650 18116 heartbeater.cc:503] Master 127.1.126.254:42953 was elected leader, sending a full tablet report...
I20260807 02:18:34.353942 18333 ts_tablet_manager.cc:1428] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 02:18:34.355024 18336 raft_consensus.cc:482] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:18:34.355191 18336 raft_consensus.cc:504] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.356242 18336 leader_election.cc:288] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5502a2e235354db5b3f739ba649c6b39 (127.1.126.193:43897), 1b41312f1c84406faa765118de997692 (127.1.126.194:45163)
I20260807 02:18:34.361507 18310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.356415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:43897 (local address 127.1.126.195:37873)
0807 02:18:34.356676 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.356693 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:34.356779 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:34.357367 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:34.357372 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:34.357394 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:18:34.357549 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.357558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.358515 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.358518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.359777 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.359786 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.361044 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.361050 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.361203 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.361230 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:18:34.361304 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 02:18:34.361370 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260807 02:18:34.361946 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.356916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:37873 (local address 127.1.126.193:43897)
0807 02:18:34.357048 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.357052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.357065 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:18:34.357110 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.357122 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.357167 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.357242 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:18:34.357682 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.358367 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.360083 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.360768 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.360876 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.360947 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.361772 (+ 825us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.361841 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:18:34.362437 17844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069e1883810f42f1acb5fde7f31741c4" candidate_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5502a2e235354db5b3f739ba649c6b39" is_pre_election: true
I20260807 02:18:34.362697 17844 raft_consensus.cc:2454] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d99dd0cd90f4fe9bc62e6b4017e3aa3 in term 0.
I20260807 02:18:34.363371 18149 leader_election.cc:302] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d99dd0cd90f4fe9bc62e6b4017e3aa3, 5502a2e235354db5b3f739ba649c6b39; no voters:
I20260807 02:18:34.363658 18336 raft_consensus.cc:2781] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:18:34.363736 18336 raft_consensus.cc:482] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:18:34.363780 18336 raft_consensus.cc:3037] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:18:34.364494 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.357064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:53325 (local address 127.1.126.194:45163)
0807 02:18:34.357167 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.357171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.359309 (+ 2138us) server_negotiation.cc:407] Connection header received
0807 02:18:34.359479 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.359482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.359523 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.359564 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:18:34.360165 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.360891 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.363133 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.363679 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.363790 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.363839 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.364326 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.364398 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:18:34.364938 18344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.356545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:45163 (local address 127.1.126.195:53325)
0807 02:18:34.359205 (+ 2660us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.359219 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:18:34.359380 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:18:34.359688 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:18:34.359691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:18:34.359707 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:18:34.360010 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.360019 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.361131 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.361136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.362985 (+ 1849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:18:34.362997 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.364044 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.364048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:18:34.364187 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.364209 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 02:18:34.364625 (+ 416us) client_negotiation.cc:240] Negotiation successful
0807 02:18:34.364699 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2593,"thread_start_us":122,"threads_started":1}
I20260807 02:18:34.365231 18336 raft_consensus.cc:504] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.365563 18336 leader_election.cc:288] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [CANDIDATE]: Term 1 election: Requested vote from peers 5502a2e235354db5b3f739ba649c6b39 (127.1.126.193:43897), 1b41312f1c84406faa765118de997692 (127.1.126.194:45163)
I20260807 02:18:34.366266 18041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069e1883810f42f1acb5fde7f31741c4" candidate_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b41312f1c84406faa765118de997692" is_pre_election: true
I20260807 02:18:34.366315 17844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069e1883810f42f1acb5fde7f31741c4" candidate_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5502a2e235354db5b3f739ba649c6b39"
I20260807 02:18:34.366322 18040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069e1883810f42f1acb5fde7f31741c4" candidate_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b41312f1c84406faa765118de997692"
I20260807 02:18:34.366431 17844 raft_consensus.cc:3037] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:18:34.366562 18041 raft_consensus.cc:2454] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d99dd0cd90f4fe9bc62e6b4017e3aa3 in term 0.
I20260807 02:18:34.367861 17844 raft_consensus.cc:2454] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d99dd0cd90f4fe9bc62e6b4017e3aa3 in term 1.
I20260807 02:18:34.368795 18149 leader_election.cc:302] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d99dd0cd90f4fe9bc62e6b4017e3aa3, 5502a2e235354db5b3f739ba649c6b39; no voters: 1b41312f1c84406faa765118de997692
I20260807 02:18:34.369091 18336 raft_consensus.cc:2781] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:18:34.369302 18336 raft_consensus.cc:686] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 1 LEADER]: Becoming Leader. State: Replica: 3d99dd0cd90f4fe9bc62e6b4017e3aa3, State: Running, Role: LEADER
I20260807 02:18:34.369603 18336 consensus_queue.cc:237] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } }
I20260807 02:18:34.373514 17626 catalog_manager.cc:5495] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d99dd0cd90f4fe9bc62e6b4017e3aa3 (127.1.126.195). New cstate: current_term: 1 leader_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d99dd0cd90f4fe9bc62e6b4017e3aa3" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 37333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260807 02:18:34.400125 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.395259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59876 (local address 127.1.126.195:37333)
0807 02:18:34.395440 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 02:18:34.395445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:18:34.395461 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:18:34.395545 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:18:34.395549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:18:34.395626 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:18:34.395739 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:18:34.396044 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.396632 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.397916 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:18:34.398260 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:18:34.398360 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:18:34.398827 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:18:34.399409 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:18:34.399523 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:18:34.399923 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 02:18:34.399979 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 02:18:34.402997 18117 tablet.cc:2369] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:18:34.407490 18040 raft_consensus.cc:3037] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:18:34.409000 18040 raft_consensus.cc:1261] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 1 FOLLOWER]: Refusing update from remote peer 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:18:34.411026 18345 consensus_queue.cc:1035] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b41312f1c84406faa765118de997692" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:18:34.412606 17844 raft_consensus.cc:1261] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39 [term 1 FOLLOWER]: Refusing update from remote peer 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:18:34.413236 18345 consensus_queue.cc:1035] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5502a2e235354db5b3f739ba649c6b39" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 43897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:18:34.419324 18351 mvcc.cc:205] Tried to move back new op lower bound from 7315739092604743680 to 7315739092463828992. Current Snapshot: MvccSnapshot[applied={T|T < 7315739092604743680}]
Aug 07 02:18:34 dist-test-slave-39l8 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069113, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:18:34.427971 18355 mvcc.cc:205] Tried to move back new op lower bound from 7315739092604743680 to 7315739092463828992. Current Snapshot: MvccSnapshot[applied={T|T < 7315739092604743680 or (T in {7315739092604743680})}]
I20260807 02:18:34.429764 18352 mvcc.cc:205] Tried to move back new op lower bound from 7315739092604743680 to 7315739092463828992. Current Snapshot: MvccSnapshot[applied={T|T < 7315739092604743680}]
I20260807 02:18:34.434377 17626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:18:34.434561 17626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:18:34.437506 17626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf3ed9f8d48c4e10a00bc443297d4405: Sending DeleteTablet for 3 replicas of tablet 069e1883810f42f1acb5fde7f31741c4
I20260807 02:18:34.438524 17821 tablet_service.cc:1514] Processing DeleteTablet for tablet 069e1883810f42f1acb5fde7f31741c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:18:34 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:35590
I20260807 02:18:34.439236 18009 tablet_service.cc:1514] Processing DeleteTablet for tablet 069e1883810f42f1acb5fde7f31741c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:18:34 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:46140
I20260807 02:18:34.439437 18212 tablet_service.cc:1514] Processing DeleteTablet for tablet 069e1883810f42f1acb5fde7f31741c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:18:34 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:59874
I20260807 02:18:34.439875 18366 tablet_replica.cc:330] T 069e1883810f42f1acb5fde7f31741c4 P 5502a2e235354db5b3f739ba649c6b39: stopping tablet replica
I20260807 02:18:34.440097 18369 tablet_replica.cc:330] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: stopping tablet replica
I20260807 02:18:34.440426 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 17738
I20260807 02:18:34.440425 18369 raft_consensus.cc:2229] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:18:34.443179 18369 raft_consensus.cc:2258] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:18:34.444636 18369 ts_tablet_manager.cc:1905] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:18:34.447350 18369 ts_tablet_manager.cc:1918] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:18:34.447517 18369 log.cc:1196] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/069e1883810f42f1acb5fde7f31741c4
I20260807 02:18:34.447896 18369 ts_tablet_manager.cc:1939] T 069e1883810f42f1acb5fde7f31741c4 P 3d99dd0cd90f4fe9bc62e6b4017e3aa3: Deleting consensus metadata
I20260807 02:18:34.449193 17602 catalog_manager.cc:4841] TS 3d99dd0cd90f4fe9bc62e6b4017e3aa3 (127.1.126.195:37333): tablet 069e1883810f42f1acb5fde7f31741c4 (table test-table [id=c04707487385479b932171ee45e9f382]) successfully deleted
I20260807 02:18:34.467374 18367 tablet_replica.cc:330] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: stopping tablet replica
I20260807 02:18:34.467921 18367 raft_consensus.cc:2229] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:18:34.468454 18367 raft_consensus.cc:2258] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 02:18:34.468995 17606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:43897 (error 108)
I20260807 02:18:34.471088 18367 ts_tablet_manager.cc:1905] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:18:34.474056 18367 ts_tablet_manager.cc:1918] T 069e1883810f42f1acb5fde7f31741c4 P 1b41312f1c84406faa765118de997692: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:18:34.475081 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 17918
I20260807 02:18:34.494870 18325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.494239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:43897 (local address 127.0.0.1:35592)
0807 02:18:34.494488 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.494603 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:43897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260807 02:18:34.495257 17606 catalog_manager.cc:4584] TS 5502a2e235354db5b3f739ba649c6b39 (127.1.126.193:43897): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 069e1883810f42f1acb5fde7f31741c4: Network error: Client connection negotiation failed: client connection to 127.1.126.193:43897: connect: Connection refused (error 111)
I20260807 02:18:34.511993 18325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:18:34.511679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:45163 (local address 127.0.0.1:46146)
0807 02:18:34.511853 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 02:18:34.511903 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.194:45163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 02:18:34.512694 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 18122
I20260807 02:18:34.521939 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 17576
I20260807 02:18:34.540553 1531 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 02:18:34.886046 1531 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 02:18:34.886296 1531 mini_ranger.cc:66] Stopping Ranger...
I20260807 02:18:35.232353 1531 mini_ranger.cc:68] Stopped Ranger
2026-08-07 02:18:35.232 UTC [17037] LOG: received smart shutdown request
2026-08-07 02:18:35.236 UTC [17037] LOG: background worker "logical replication launcher" (PID 17046) exited with exit code 1
2026-08-07 02:18:35.236 UTC [17041] LOG: shutting down
2026-08-07 02:18:35.371 UTC [17037] LOG: database system is shut down
2026-08-07T02:18:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47006 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:18:35 dist-test-slave-39l8 krb5kdc[18386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:18:35 dist-test-slave-39l8 krb5kdc[18386](info): set up 2 sockets
Aug 07 02:18:35 dist-test-slave-39l8 krb5kdc[18386](info): commencing operation
krb5kdc: starting...
W20260807 02:18:36.648432 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:18:36 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:18:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:18:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/rangeradmin_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/rangeradmin_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/rangerlookup_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/rangerlookup_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
I20260807 02:18:36.802897 1531 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskd_5Q2x/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/postgres -l logfile start
2026-08-07 02:18:39.041 UTC [18424] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 02:18:39.041 UTC [18424] LOG: listening on IPv4 address "127.1.126.212", port 34079
2026-08-07 02:18:39.044 UTC [18424] LOG: listening on Unix socket "/tmp/.s.PGSQL.34079"
2026-08-07 02:18:39.064 UTC [18428] LOG: database system was shut down at 2026-08-07 02:18:37 UTC
2026-08-07 02:18:39.068 UTC [18424] LOG: database system is ready to accept connections
I20260807 02:18:40.158012 1531 mini_postgres.cc:96] Postgres bound to 34079
2026-08-07 02:18:40.165 UTC [18437] FATAL: database "slave" does not exist
127.1.126.212:34079 - accepting connections
I20260807 02:18:40.166401 1531 mini_ranger.cc:161] Starting Ranger...
I20260807 02:18:40.181632 1531 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 02:18:40.562875 1531 mini_ranger.cc:87] Created ranger Postgres database
I20260807 02:18:40.562949 1531 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-admin
2026-08-07 02:18:40,835 [I] DB FLAVOR :POSTGRES
2026-08-07 02:18:40,835 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 02:18:40,835 [I] Checking connection..
2026-08-07 02:18:40,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 02:18:41,066 [I] Checking connection passed.
2026-08-07 02:18:41,066 [I] --------- Verifying version history table ---------
2026-08-07 02:18:41,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 02:18:41,318 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 02:18:41,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 02:18:41,573 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 02:18:41,574 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 02:18:41,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 02:18:41.793 UTC [18530] WARNING: there is no transaction in progress
2026-08-07 02:18:41,802 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 02:18:41,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 02:18:42,061 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 02:18:42,061 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 02:18:42,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 02:18:42,307 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 02:18:42,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-39l8.c.gcp-upstream.internal','N') ;"
2026-08-07 02:18:42,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 02:18:43,033 [I] Table x_portal_user does not exist in database ranger
2026-08-07 02:18:43,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 02:18:43,290 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 02:18:43,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 02:18:43,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 02:18:43,772 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 02:18:43,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 02:18:44.708 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.723 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.739 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.753 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.768 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.785 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.859 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.865 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.878 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.888 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.898 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.912 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.921 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.928 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.934 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:44.940 UTC [18674] WARNING: there is no transaction in progress
2026-08-07 02:18:45,492 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 02:18:45,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 02:18:45,745 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 02:18:45,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 02:18:45,992 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 02:18:45,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 02:18:46,230 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 02:18:46,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 02:18:46,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 02:18:46,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-39l8.c.gcp-upstream.internal';"
2026-08-07 02:18:46,917 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 02:18:46,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 02:18:47,173 [I] DB_PATCHES have already been applied
I20260807 02:18:47.178653 1531 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-admin:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskd_5Q2x/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 02:18:47.178757 1531 mini_ranger.cc:193] Using host: 127.1.126.212
I20260807 02:18:47.182991 1531 mini_ranger.cc:227] Ranger admin URL: http://127.1.126.212:47767
Aug 07, 2026 2:18:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 2:18:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 2:18:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 2:18:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 2:18:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 2:18:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 2:18:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 02:18:48.458124 1531 mini_ranger.cc:160] Time spent starting Ranger: real 8.292s user 0.003s sys 0.007s
Aug 07, 2026 2:19:07 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 2:19:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 2:19:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 2:19:07 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 2:19:08 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 02:19:08.979852 1531 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.126.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.126.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/rangerkms_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.126.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/rangerkms_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.126.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.126.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.126.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/HTTP_127.1.126.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 02:19:09 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069149, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 02:19:09.091028 1531 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 02:19:09.102210 1531 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 02:19:09.915722 1531 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 02:19:09.915853 1531 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms
I20260807 02:19:09.915879 1531 mini_ranger_kms.cc:227] Using postgres at 127.1.126.212:34079
2026-08-07 02:19:10,091 [I] DB FLAVOR :POSTGRES
2026-08-07 02:19:10,091 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 02:19:10,091 [I] Checking connection
2026-08-07 02:19:10,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 02:19:10,323 [I] connection success
2026-08-07 02:19:10,323 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 02:19:10,323 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 02:19:10,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 02:19:10,553 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 02:19:10,553 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 02:19:10,553 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 02:19:10,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.126.212:34079/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 02:19:10,819 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 02:19:11.298049 1531 mini_ranger_kms.cc:310] Created kms service
I20260807 02:19:11.474450 1531 mini_ranger_kms.cc:326] Created kudu user
I20260807 02:19:11.516670 1531 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 02:19:11 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069149, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:11.924770 1531 mini_ranger_kms.cc:384] Added ranger policy
I20260807 02:19:11.924921 1531 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms:/tmp/dist-test-taskd_5Q2x/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskd_5Q2x/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 02:19:11.924958 1531 mini_ranger_kms.cc:240] Using host: 127.1.126.212
I20260807 02:19:11.929744 1531 mini_ranger_kms.cc:276] Ranger KMS PID: 18933
I20260807 02:19:11.929841 1531 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.126.212:60829
Aug 07, 2026 2:19:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 2:19:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 2:19:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 2:19:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 2:19:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 2:19:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 02:19:14 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786069154, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.126.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:14.585331 1531 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.494s user 0.002s sys 0.158s
I20260807 02:19:14.585455 1531 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 02:19:14.585522 1531 mini_ranger_kms.cc:401] 127.1.126.212:60829/kms/v1/keys
Aug 07 02:19:14 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069154, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.126.212@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
Aug 07 02:19:15 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069154, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.126.212@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
Aug 07 02:19:17 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069157, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:19:17.466454 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36933
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36933
--ranger_config_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:17.581712 19010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:17.582049 19010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:17.582121 19010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:17.586071 19010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:17.586134 19010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:17.586154 19010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:17.586170 19010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:17.586185 19010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:17.591527 19010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.126.212:60829/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36933
--ranger_config_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:17.592617 19010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:17.593578 19010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:17.602540 19016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:17.602563 19015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:17.602548 19023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:17.602617 19010 server_base.cc:1034] running on GCE node
I20260807 02:19:17.603416 19010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:17.604486 19010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:17.605686 19010 hybrid_clock.cc:648] HybridClock initialized: now 1786069157605670 us; error 38 us; skew 500 ppm
Aug 07 02:19:17 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069157, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:17.608502 19010 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:17.609385 19010 webserver.cc:460] Webserver started at http://127.1.126.254:42119/ using document root <none> and password file <none>
I20260807 02:19:17.609964 19010 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:17.610044 19010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:17.610275 19010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:19:17 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069157, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:17.665410 19010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "8da0d92940714b529335e9fb77aa9efc"
format_stamp: "Formatted at 2026-08-07 02:19:17 on dist-test-slave-39l8"
server_key: "9d0d781a574ed8fe4204d4e177b1f4f2"
server_key_iv: "2e0eef85411e33db0d7950178f5b5460"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:17.666045 19010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "8da0d92940714b529335e9fb77aa9efc"
format_stamp: "Formatted at 2026-08-07 02:19:17 on dist-test-slave-39l8"
server_key: "9d0d781a574ed8fe4204d4e177b1f4f2"
server_key_iv: "2e0eef85411e33db0d7950178f5b5460"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:17.670071 19010 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:19:17.685369 19030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:17.686856 19010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 02:19:17.687014 19010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "8da0d92940714b529335e9fb77aa9efc"
format_stamp: "Formatted at 2026-08-07 02:19:17 on dist-test-slave-39l8"
server_key: "9d0d781a574ed8fe4204d4e177b1f4f2"
server_key_iv: "2e0eef85411e33db0d7950178f5b5460"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:17.687168 19010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:17.705309 19010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:17.708262 19010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:17.708473 19010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:17.716777 19010 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36933
I20260807 02:19:17.716785 19100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36933 every 8 connection(s)
I20260807 02:19:17.717754 19010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:17.720636 19103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:17.724609 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 19010
I20260807 02:19:17.724740 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:19:17.725062 1531 external_mini_cluster.cc:1428] Setting key b72752307d64f2d4682efecb5d9bded8
I20260807 02:19:17.726687 19103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Bootstrap starting.
I20260807 02:19:17.729532 19103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:17.730396 19103 log.cc:824] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:17.732648 19103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: No bootstrap required, opened a new log
Aug 07 02:19:17 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069157, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:17.737106 19103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:17.737437 19103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:17.737543 19103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da0d92940714b529335e9fb77aa9efc, State: Initialized, Role: FOLLOWER
I20260807 02:19:17.738144 19103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:17.738319 19103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:17.738415 19103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:17.738526 19103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:17.739638 19103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:17.739997 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8da0d92940714b529335e9fb77aa9efc; no voters:
I20260807 02:19:17.740370 19103 leader_election.cc:288] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:19:17.740442 19108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:17.740738 19108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 LEADER]: Becoming Leader. State: Replica: 8da0d92940714b529335e9fb77aa9efc, State: Running, Role: LEADER
I20260807 02:19:17.741254 19108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:17.741789 19103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:17.742547 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:17.726624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35354 (local address 127.1.126.254:36933)
0807 02:19:17.727113 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:17.727133 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:17.727176 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:19:17.728035 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:17.728060 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:17.728482 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:17.728847 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:17.729760 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:17.731348 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:17.732564 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:17.733287 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:17.733456 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:17.736600 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:17.736608 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:17.736625 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:17.736658 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:17.738840 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:17.739348 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:17.739355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:17.739361 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:17.739503 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:17.739848 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:17.739852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:17.739853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:17.740393 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:17.741164 (+ 771us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:17.741318 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 02:19:17.741597 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":138,"threads_started":1}
I20260807 02:19:17.742555 19108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8da0d92940714b529335e9fb77aa9efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } } }
I20260807 02:19:17.742944 19108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:17.743206 19108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8da0d92940714b529335e9fb77aa9efc. Latest consensus state: current_term: 1 leader_uuid: "8da0d92940714b529335e9fb77aa9efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } } }
I20260807 02:19:17.743355 19108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:17.744710 19103 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 02:19:17.751430 19114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:17.756685 19114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:17.767635 19114 catalog_manager.cc:1347] Generated new cluster ID: 76059fd655f04ed6922a322c3baf7ce4
I20260807 02:19:17.767729 19114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:17.786767 19114 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:19:17.788043 19114 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:17.800814 19114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Generated new TSK 0
I20260807 02:19:17.801656 19114 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:19:18.532081 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36933
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:18.674750 19165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:18.675166 19165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:18.675282 19165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:18.681100 19165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:18.681159 19165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:18.681216 19165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:19:18.688370 19165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.126.212:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:18.689670 19165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:18.691079 19165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:18.702694 19177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:18.702696 19174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:18.703745 19173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:18.704073 19165 server_base.cc:1034] running on GCE node
I20260807 02:19:18.704566 19165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:18.705372 19165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:18.706615 19165 hybrid_clock.cc:648] HybridClock initialized: now 1786069158706585 us; error 45 us; skew 500 ppm
Aug 07 02:19:18 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069158, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:18.710253 19165 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:19:18.711369 19165 webserver.cc:460] Webserver started at http://127.1.126.193:36333/ using document root <none> and password file <none>
I20260807 02:19:18.712124 19165 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:18.712247 19165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:18.712505 19165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:19:18 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069158, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:18.728524 19165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "5c3eb2a0e13b4821b559f1c0747d7754"
format_stamp: "Formatted at 2026-08-07 02:19:18 on dist-test-slave-39l8"
server_key: "d0faba82d936cfeaf5c4f2d221b0faa7"
server_key_iv: "7c35a22fbf666a71bd5a84a347bb78b1"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:18.729192 19165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "5c3eb2a0e13b4821b559f1c0747d7754"
format_stamp: "Formatted at 2026-08-07 02:19:18 on dist-test-slave-39l8"
server_key: "d0faba82d936cfeaf5c4f2d221b0faa7"
server_key_iv: "7c35a22fbf666a71bd5a84a347bb78b1"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:18.735937 19165 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 02:19:18.751581 19186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:18.753202 19165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:18.753360 19165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "5c3eb2a0e13b4821b559f1c0747d7754"
format_stamp: "Formatted at 2026-08-07 02:19:18 on dist-test-slave-39l8"
server_key: "d0faba82d936cfeaf5c4f2d221b0faa7"
server_key_iv: "7c35a22fbf666a71bd5a84a347bb78b1"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:18.753492 19165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:18.770059 19165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:18.773744 19165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:18.773944 19165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:18.774618 19165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:18.775708 19165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:18.775774 19165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:18.775837 19165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:18.775864 19165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:18.786408 19165 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:44397
I20260807 02:19:18.787616 19165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:19:18.787711 19344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:44397 every 8 connection(s)
I20260807 02:19:18.792304 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 19165
I20260807 02:19:18.792434 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:19:18.792739 1531 external_mini_cluster.cc:1428] Setting key fad090a8f31ce5c0dfeed8f80b9ad08d
Aug 07 02:19:18 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069158, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:18.805240 19348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:18.790135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36933 (local address 127.1.126.193:53327)
0807 02:19:18.791533 (+ 1398us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:18.791604 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:18.792661 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:18.793509 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:18.793518 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:18.793882 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:18.794539 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:18.794558 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:18.795760 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:18.795764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:18.797189 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:18.797201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:18.797938 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:18.797942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:18.798080 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:18.798788 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:18.798812 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:18.800360 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:18.802305 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:18.802312 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:18.802328 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:18.802591 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:18.802930 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:18.802934 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:18.802936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:18.803079 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:18.803494 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:18.803502 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:18.803859 (+ 357us) client_negotiation.cc:769] Sending connection context
0807 02:19:18.804073 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 02:19:18.804394 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1168,"thread_start_us":155,"threads_started":1}
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:19:18.805780 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:18.791058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:53327 (local address 127.1.126.254:36933)
0807 02:19:18.791408 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:18.791417 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:18.791725 (+ 308us) server_negotiation.cc:407] Connection header received
0807 02:19:18.793027 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:18.793031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:18.793092 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:18.793186 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:18.794752 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:18.795605 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:18.797338 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:18.797685 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:18.797792 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:18.800533 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:18.800537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:18.800540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:18.800573 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:18.802161 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:18.802739 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:18.802742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:18.802744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:18.802832 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:18.803196 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:18.803199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:18.803201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:18.803384 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:18.803515 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:18.805524 (+ 2009us) server_negotiation.cc:299] Negotiation successful
0807 02:19:18.805657 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":134,"threads_started":1}
I20260807 02:19:18.807332 19345 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36933
I20260807 02:19:18.807617 19345 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:18.808248 19345 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:18.810066 19054 ts_manager.cc:194] Registered new tserver with Master: 5c3eb2a0e13b4821b559f1c0747d7754 (127.1.126.193:44397)
I20260807 02:19:18.811831 19054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:53327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:19:18.833539 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36933
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:19:18 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786069158, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 02:19:18.999030 19356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:18.999387 19356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:18.999456 19356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:19.005451 19356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:19.005535 19356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:19.005642 19356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:19:19.013665 19356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.126.212:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:19.015044 19356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:19.016369 19356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:19.028800 19366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:19.029006 19368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:19.028944 19370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:19.029927 19356 server_base.cc:1034] running on GCE node
I20260807 02:19:19.030385 19356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:19.031152 19356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:19.032367 19356 hybrid_clock.cc:648] HybridClock initialized: now 1786069159032342 us; error 42 us; skew 500 ppm
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:19.035977 19356 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:19:19.037083 19356 webserver.cc:460] Webserver started at http://127.1.126.194:40753/ using document root <none> and password file <none>
I20260807 02:19:19.037832 19356 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:19.037932 19356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:19.038174 19356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:19.053424 19356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "8b5fef6e86da419fade4d54a2f46afa7"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "17c9a34e1b7c23d541f06f8f5abc21c2"
server_key_iv: "53d586e21b26614a02cc008fc8362ca6"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.054255 19356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "8b5fef6e86da419fade4d54a2f46afa7"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "17c9a34e1b7c23d541f06f8f5abc21c2"
server_key_iv: "53d586e21b26614a02cc008fc8362ca6"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.062816 19356 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s
I20260807 02:19:19.091133 19381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:19.093003 19356 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.004s sys 0.000s
I20260807 02:19:19.093159 19356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "8b5fef6e86da419fade4d54a2f46afa7"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "17c9a34e1b7c23d541f06f8f5abc21c2"
server_key_iv: "53d586e21b26614a02cc008fc8362ca6"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.093327 19356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:19.123844 19356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:19.127743 19356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:19.127951 19356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:19.128703 19356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:19.129825 19356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:19.129894 19356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:19.129961 19356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:19.129997 19356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:19.145211 19356 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:46207
I20260807 02:19:19.146412 19356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:19:19.148221 19535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:46207 every 8 connection(s)
I20260807 02:19:19.156605 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 19356
I20260807 02:19:19.156749 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:19:19.157092 1531 external_mini_cluster.cc:1428] Setting key 3de38964315609ff6bda45a570960be8
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:19.168823 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:19.150132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:55141 (local address 127.1.126.254:36933)
0807 02:19:19.150290 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:19.150314 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:19.155165 (+ 4851us) server_negotiation.cc:407] Connection header received
0807 02:19:19.156476 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:19.156483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:19.156543 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:19.156606 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:19.158376 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.159136 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.160984 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.161319 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.161398 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:19.164441 (+ 3043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:19.164446 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:19.164448 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:19.164475 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:19.166287 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:19.166963 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:19.166967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:19.166969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:19.167057 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:19.167484 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:19.167488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:19.167490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:19.167724 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:19.167816 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:19.168486 (+ 670us) server_negotiation.cc:299] Negotiation successful
0807 02:19:19.168622 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 02:19:19.170599 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:19.150656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36933 (local address 127.1.126.194:55141)
0807 02:19:19.154984 (+ 4328us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:19.155051 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:19.156195 (+ 1144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:19.157068 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:19.157077 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:19.157433 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:19.158197 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:19.158216 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.159357 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.159363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:19.160814 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:19.160829 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.161600 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.161604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:19.161817 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:19.162508 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:19.162529 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:19.164247 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:19.166434 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:19.166441 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:19.166458 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:19.166837 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:19.167179 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:19.167182 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:19.167184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:19.167362 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:19.167889 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:19.167895 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:19.168202 (+ 307us) client_negotiation.cc:769] Sending connection context
0807 02:19:19.169033 (+ 831us) client_negotiation.cc:240] Negotiation successful
0807 02:19:19.169401 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4069,"thread_start_us":137,"threads_started":1}
I20260807 02:19:19.171964 19536 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36933
I20260807 02:19:19.172258 19536 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:19.172777 19536 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:19.173980 19054 ts_manager.cc:194] Registered new tserver with Master: 8b5fef6e86da419fade4d54a2f46afa7 (127.1.126.194:46207)
I20260807 02:19:19.174753 19054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:55141
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:19:19.202912 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36933
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:19.377723 19543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:19.378106 19543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:19.378202 19543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:19.384639 19543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:19.384724 19543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:19.384821 19543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:19:19.392828 19543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.126.212:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:19.394309 19543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:19.395690 19543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:19.408834 19549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:19.409274 19548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:19.409497 19553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:19.410578 19543 server_base.cc:1034] running on GCE node
I20260807 02:19:19.411082 19543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:19.411916 19543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:19.427376 19543 hybrid_clock.cc:648] HybridClock initialized: now 1786069159427287 us; error 127 us; skew 500 ppm
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:19.431161 19543 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:19:19.432291 19543 webserver.cc:460] Webserver started at http://127.1.126.195:45405/ using document root <none> and password file <none>
I20260807 02:19:19.432987 19543 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:19.433073 19543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:19.433328 19543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:19.465198 19543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "7db174cecb214414abe7a8535022115f"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "15ce0c1af1cfd76a9f1f86b63760abd1"
server_key_iv: "a1da4e8c46114b2716eae1a993225da9"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.466050 19543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "7db174cecb214414abe7a8535022115f"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "15ce0c1af1cfd76a9f1f86b63760abd1"
server_key_iv: "a1da4e8c46114b2716eae1a993225da9"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.471632 19543 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069158, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:19.502848 19562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:19.504798 19543 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260807 02:19:19.504949 19543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "7db174cecb214414abe7a8535022115f"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "15ce0c1af1cfd76a9f1f86b63760abd1"
server_key_iv: "a1da4e8c46114b2716eae1a993225da9"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.505131 19543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:19.530829 19543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:19.535269 19543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:19.535575 19543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:19.536667 19543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:19.537971 19543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:19.538113 19543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 02:19:19.538244 19543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:19.538328 19543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:19.557574 19543 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:32951
I20260807 02:19:19.559154 19543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:19:19.566250 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 19543
I20260807 02:19:19.566392 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:19:19.566749 1531 external_mini_cluster.cc:1428] Setting key 3fe42630dbe5fd40b535ac9c1d4a81fb
I20260807 02:19:19.560005 19728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:32951 every 8 connection(s)
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:19.586426 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:19.564058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:43797 (local address 127.1.126.254:36933)
0807 02:19:19.564208 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:19.564213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:19.565306 (+ 1093us) server_negotiation.cc:407] Connection header received
0807 02:19:19.566934 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:19.566939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:19.567005 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:19.567080 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:19.570733 (+ 3653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.571578 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.573554 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.573893 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.573974 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:19.578147 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:19.578154 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:19.578158 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:19.578210 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:19.583089 (+ 4879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:19.584138 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:19.584143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:19.584147 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:19.584268 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:19.584784 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:19.584789 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:19.584793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:19.585069 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:19.585157 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:19.585992 (+ 835us) server_negotiation.cc:299] Negotiation successful
0807 02:19:19.586154 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:19:19.588811 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:19.562799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36933 (local address 127.1.126.195:43797)
0807 02:19:19.565131 (+ 2332us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:19.565190 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:19.566636 (+ 1446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:19.569393 (+ 2757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:19.569404 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:19.569803 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:19.570502 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:19.570537 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.571770 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.571777 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:19.573384 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:19.573397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:19.574199 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:19.574203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:19.574412 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:19.575418 (+ 1006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:19.575451 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:19.577874 (+ 2423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:19.583328 (+ 5454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:19.583338 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:19.583363 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:19.583985 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:19.584400 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:19.584405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:19.584410 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:19.584657 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:19.585256 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:19.585265 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:19.585665 (+ 400us) client_negotiation.cc:769] Sending connection context
0807 02:19:19.586998 (+ 1333us) client_negotiation.cc:240] Negotiation successful
0807 02:19:19.587407 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2100,"thread_start_us":190,"threads_started":1}
I20260807 02:19:19.590505 19729 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36933
I20260807 02:19:19.590902 19729 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:19.591496 19729 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:19.594332 19054 ts_manager.cc:194] Registered new tserver with Master: 7db174cecb214414abe7a8535022115f (127.1.126.195:32951)
I20260807 02:19:19.595525 19054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:43797
I20260807 02:19:19.605345 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:19:19.606148 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 19165
I20260807 02:19:19.625617 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 19356
I20260807 02:19:19.638502 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 19543
I20260807 02:19:19.661852 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 19010
I20260807 02:19:19.676548 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36933
--webserver_interface=127.1.126.254
--webserver_port=42119
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36933
--ranger_config_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:19.805573 19734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:19.805886 19734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:19.805928 19734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:19.810477 19734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:19.810539 19734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:19.810561 19734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:19.810581 19734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:19.810597 19734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:19.816491 19734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36933
--ranger_config_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=42119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:19.817557 19734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:19.818608 19734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:19.827134 19739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:19.827169 19745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:19.827142 19742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:19.827457 19734 server_base.cc:1034] running on GCE node
I20260807 02:19:19.828055 19734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:19.829124 19734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:19.830289 19734 hybrid_clock.cc:648] HybridClock initialized: now 1786069159830270 us; error 33 us; skew 500 ppm
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:19.833190 19734 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:19.834103 19734 webserver.cc:460] Webserver started at http://127.1.126.254:42119/ using document root <none> and password file <none>
I20260807 02:19:19.834637 19734 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:19.834756 19734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 02:19:19 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069159, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:19.919138 19734 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:19:19.921583 19756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:19.923040 19734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:19.923188 19734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "8da0d92940714b529335e9fb77aa9efc"
format_stamp: "Formatted at 2026-08-07 02:19:17 on dist-test-slave-39l8"
server_key: "9d0d781a574ed8fe4204d4e177b1f4f2"
server_key_iv: "2e0eef85411e33db0d7950178f5b5460"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:19.923758 19734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:19.943320 19734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:19.945878 19734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:19.946085 19734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:19.953349 19734 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36933
I20260807 02:19:19.953361 19837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36933 every 8 connection(s)
I20260807 02:19:19.954448 19734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:19.955539 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 19734
I20260807 02:19:19.956059 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:44397
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:36933
--webserver_port=36333
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:19.959813 19839 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:19:19.961520 19839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Bootstrap starting.
I20260807 02:19:19.977859 19839 log.cc:824] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:19.984498 19839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:19:19.984907 19839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Bootstrap complete.
I20260807 02:19:19.989020 19839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:19.989389 19839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da0d92940714b529335e9fb77aa9efc, State: Initialized, Role: FOLLOWER
I20260807 02:19:19.989908 19839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:19.990025 19839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:19.990106 19839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:19.990226 19839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 1 FOLLOWER]: Advancing to term 2
I20260807 02:19:19.992183 19839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:19.992511 19839 leader_election.cc:302] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8da0d92940714b529335e9fb77aa9efc; no voters:
I20260807 02:19:19.992838 19839 leader_election.cc:288] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 02:19:19.992925 19845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 02:19:19.993127 19845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [term 2 LEADER]: Becoming Leader. State: Replica: 8da0d92940714b529335e9fb77aa9efc, State: Running, Role: LEADER
I20260807 02:19:19.993417 19845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } }
I20260807 02:19:19.994056 19839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:19.994359 19849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8da0d92940714b529335e9fb77aa9efc. Latest consensus state: current_term: 2 leader_uuid: "8da0d92940714b529335e9fb77aa9efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } } }
I20260807 02:19:19.994493 19849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:19.994762 19847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8da0d92940714b529335e9fb77aa9efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da0d92940714b529335e9fb77aa9efc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36933 } } }
I20260807 02:19:19.994869 19847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:19.995198 19852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:19.998354 19852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:19.998999 19839 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 02:19:19.999044 19852 catalog_manager.cc:1259] Loaded cluster ID: 76059fd655f04ed6922a322c3baf7ce4
I20260807 02:19:19.999096 19852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:20.001466 19852 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:20.002147 19852 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Loaded TSK: 0
I20260807 02:19:20.005514 19852 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 02:19:20.080991 19841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:20.081276 19841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:20.081359 19841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:20.085534 19841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:20.085624 19841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:20.085739 19841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:19:20.092886 19841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:44397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=36333
--tserver_master_addrs=127.1.126.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:20.094412 19841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:20.095701 19841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:20.106271 19897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:20.106515 19895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:20.106321 19894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:20.107741 19841 server_base.cc:1034] running on GCE node
I20260807 02:19:20.108162 19841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:20.108871 19841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:20.110051 19841 hybrid_clock.cc:648] HybridClock initialized: now 1786069160110017 us; error 47 us; skew 500 ppm
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:20.117524 19841 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:19:20.118463 19841 webserver.cc:460] Webserver started at http://127.1.126.193:36333/ using document root <none> and password file <none>
I20260807 02:19:20.119230 19841 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:20.119352 19841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:20.140537 19841 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20260807 02:19:20.144022 19909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.145705 19841 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 02:19:20.145839 19841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "5c3eb2a0e13b4821b559f1c0747d7754"
format_stamp: "Formatted at 2026-08-07 02:19:18 on dist-test-slave-39l8"
server_key: "d0faba82d936cfeaf5c4f2d221b0faa7"
server_key_iv: "7c35a22fbf666a71bd5a84a347bb78b1"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:20.146565 19841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:20.161504 19841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:20.164994 19841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:20.165220 19841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:20.165896 19841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:20.166874 19841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:20.166944 19841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.167011 19841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:20.167038 19841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.177964 19841 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:44397
I20260807 02:19:20.178192 20078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:44397 every 8 connection(s)
I20260807 02:19:20.179205 19841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:19:20.184211 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 19841
I20260807 02:19:20.184643 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:46207
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:36933
--webserver_port=40753
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:20.202364 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.181986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36933 (local address 127.1.126.193:39627)
0807 02:19:20.182796 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:20.182849 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:20.183700 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:20.188318 (+ 4618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:20.188325 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:20.188698 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:20.189363 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:20.189389 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.190740 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.190747 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:20.192225 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:20.192239 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.193120 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.193124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:20.193315 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.194018 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:20.194039 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:20.195875 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:20.198599 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:20.198606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:20.198620 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:20.198986 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:20.199445 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:20.199449 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:20.199451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:20.199631 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:20.200462 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:20.200469 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:20.200764 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 02:19:20.200965 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 02:19:20.201322 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":140,"threads_started":1}
I20260807 02:19:20.204164 20086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.181838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:39627 (local address 127.1.126.254:36933)
0807 02:19:20.182496 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:20.182518 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:20.182986 (+ 468us) server_negotiation.cc:407] Connection header received
0807 02:19:20.186865 (+ 3879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:20.186882 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:20.187322 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:20.187743 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:20.189555 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.190564 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.192382 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.192946 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.193126 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.196135 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:20.196143 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:20.196159 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:20.196205 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:20.198451 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.199130 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.199136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.199141 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.199322 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.199755 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.199759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.199761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.200263 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:20.200399 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:20.202961 (+ 2562us) server_negotiation.cc:299] Negotiation successful
0807 02:19:20.203260 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":130,"threads_started":1}
I20260807 02:19:20.207854 20083 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36933
I20260807 02:19:20.208143 20083 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.208739 20083 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
W20260807 02:19:20.211032 20083 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36933 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 02:19:20.211182 20083 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.211365 20083 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:20.212224 20083 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.212399 20083 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
W20260807 02:19:20.213197 20083 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:19:20.342861 20089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:20.343278 20089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:20.343405 20089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:20.349370 20089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:20.349447 20089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:20.349530 20089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:19:20.356493 20089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:46207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=40753
--tserver_master_addrs=127.1.126.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:20.357556 20089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:20.358584 20089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:20.369226 20103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:20.369246 20099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:20.369230 20100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:20.370297 20089 server_base.cc:1034] running on GCE node
I20260807 02:19:20.370766 20089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:20.371627 20089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:20.372823 20089 hybrid_clock.cc:648] HybridClock initialized: now 1786069160372807 us; error 30 us; skew 500 ppm
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:20.376461 20089 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:19:20.377604 20089 webserver.cc:460] Webserver started at http://127.1.126.194:40753/ using document root <none> and password file <none>
I20260807 02:19:20.378387 20089 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:20.378551 20089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:20.401453 20089 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.002s sys 0.001s
I20260807 02:19:20.404448 20115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.406137 20089 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 02:19:20.406287 20089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "8b5fef6e86da419fade4d54a2f46afa7"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "17c9a34e1b7c23d541f06f8f5abc21c2"
server_key_iv: "53d586e21b26614a02cc008fc8362ca6"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:20.407078 20089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:20.427043 20089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:20.430562 20089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:20.430804 20089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:20.431463 20089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:20.432408 20089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:20.432458 20089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.432497 20089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:20.432548 20089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.444298 20089 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:46207
I20260807 02:19:20.444317 20278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:46207 every 8 connection(s)
I20260807 02:19:20.445374 20089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:19:20.451993 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 20089
I20260807 02:19:20.452526 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.126.212:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:32951
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:36933
--webserver_port=45405
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:20.471997 20086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.447532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:47845 (local address 127.1.126.254:36933)
0807 02:19:20.447680 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:20.447684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:20.450137 (+ 2453us) server_negotiation.cc:407] Connection header received
0807 02:19:20.451500 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:20.451504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:20.451564 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:20.451620 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:20.453275 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.454127 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.455836 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.456235 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.456329 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.466774 (+ 10445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:20.466782 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:20.466785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:20.466827 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:20.468919 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.469744 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.469751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.469755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.469858 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.470381 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.470386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.470389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.470677 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:20.470798 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:20.471679 (+ 881us) server_negotiation.cc:299] Negotiation successful
0807 02:19:20.471821 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:19:20.473727 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.448062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36933 (local address 127.1.126.194:47845)
0807 02:19:20.449916 (+ 1854us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:20.449975 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:20.451193 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:20.452040 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:20.452067 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:20.452416 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:20.453100 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:20.453118 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.454284 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.454287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:20.455690 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:20.455702 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.456555 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.456561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:20.456759 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.457425 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:20.457445 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:20.466442 (+ 8997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:20.469117 (+ 2675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:20.469129 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:20.469152 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:20.469602 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:20.469993 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:20.469998 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:20.470001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:20.470248 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:20.470901 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:20.470908 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:20.471338 (+ 430us) client_negotiation.cc:769] Sending connection context
0807 02:19:20.472300 (+ 962us) client_negotiation.cc:240] Negotiation successful
0807 02:19:20.472670 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1599,"thread_start_us":154,"threads_started":1}
I20260807 02:19:20.475140 20280 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36933
I20260807 02:19:20.475407 20280 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.475970 20280 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
W20260807 02:19:20.477766 20280 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36933 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 02:19:20.477895 20280 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.478076 20280 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:20.478868 20280 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.479054 20280 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
W20260807 02:19:20.479782 20280 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:19:20.597468 20283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:20.597810 20283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:20.597896 20283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:20.602926 20283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:20.603001 20283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:20.603106 20283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:19:20.610755 20283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.126.212:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:32951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=45405
--tserver_master_addrs=127.1.126.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:20.612056 20283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:20.613165 20283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:20.623073 20294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:20.623230 20283 server_base.cc:1034] running on GCE node
W20260807 02:19:20.623443 20293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:20.623687 20296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:20.624109 20283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:20.625029 20283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:20.626232 20283 hybrid_clock.cc:648] HybridClock initialized: now 1786069160626195 us; error 52 us; skew 500 ppm
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:20.631151 20283 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:19:20.632251 20283 webserver.cc:460] Webserver started at http://127.1.126.195:45405/ using document root <none> and password file <none>
I20260807 02:19:20.632949 20283 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:20.633046 20283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:20.651134 20283 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 02:19:20.653748 20306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.655148 20283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:20.655314 20283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "7db174cecb214414abe7a8535022115f"
format_stamp: "Formatted at 2026-08-07 02:19:19 on dist-test-slave-39l8"
server_key: "15ce0c1af1cfd76a9f1f86b63760abd1"
server_key_iv: "a1da4e8c46114b2716eae1a993225da9"
server_key_version: "kuduclusterkey@0"
I20260807 02:19:20.655872 20283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:20.675683 20283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:20.679431 20283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:20.679651 20283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:20.680421 20283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:20.681483 20283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:20.681550 20283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.681608 20283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:20.681649 20283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:20.694926 20283 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:32951
I20260807 02:19:20.695050 20468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:32951 every 8 connection(s)
I20260807 02:19:20.696638 20283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:19:20.697479 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 20283
Aug 07 02:19:20 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069160, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:20.712502 20086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.698298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35360 (local address 127.1.126.254:36933)
0807 02:19:20.698452 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:20.698457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:20.698790 (+ 333us) server_negotiation.cc:407] Connection header received
0807 02:19:20.699018 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:20.699022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:20.699078 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:20.699134 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:20.700213 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.701005 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.704069 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.704404 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.704520 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.707162 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:20.707166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:20.707169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:20.707201 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:20.708717 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.709543 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.709552 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.709553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.709661 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.711545 (+ 1884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.711549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.711551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.711745 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:20.711974 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:20.712174 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 02:19:20.712306 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:19:20.718165 20473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.700289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:46249 (local address 127.1.126.254:36933)
0807 02:19:20.701227 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:20.701229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:20.701592 (+ 363us) server_negotiation.cc:407] Connection header received
0807 02:19:20.702511 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:20.702514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:20.702564 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:20.702653 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:20.703870 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.704635 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.706169 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.706540 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.706673 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.713165 (+ 6492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:20.713168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:20.713171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:20.713197 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:20.714980 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.716580 (+ 1600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.716585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.716587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.716674 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:20.717022 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:20.717026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:20.717027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:20.717212 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:20.717321 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:20.717867 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 02:19:20.717986 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":878,"thread_start_us":94,"threads_started":1}
I20260807 02:19:20.719439 20474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:20.700187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36933 (local address 127.1.126.195:46249)
0807 02:19:20.701444 (+ 1257us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:20.701487 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:20.702312 (+ 825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:20.702855 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:20.702862 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:20.703236 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:20.703724 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:20.703738 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.704750 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.704754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:20.705998 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:20.706016 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:20.706884 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:20.706889 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:20.707710 (+ 821us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:20.709348 (+ 1638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:20.709375 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:20.712001 (+ 2626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:20.715467 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:20.715473 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:20.715489 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:20.716473 (+ 984us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:20.716768 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:20.716772 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:20.716774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:20.716921 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:20.717321 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:20.717329 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:20.717602 (+ 273us) client_negotiation.cc:769] Sending connection context
0807 02:19:20.717815 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 02:19:20.718133 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"thread_start_us":147,"threads_started":1}
I20260807 02:19:20.720667 20470 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36933
I20260807 02:19:20.720947 20470 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.721566 20470 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
W20260807 02:19:20.723223 20470 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36933 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 02:19:20.723356 20470 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.723526 20470 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:20.724335 20470 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:20.724530 20470 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
W20260807 02:19:20.725296 20470 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 02:19:21 dist-test-slave-39l8 krb5kdc[18386](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786069161, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:21.213438 20083 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:21.213745 20083 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:21.215045 19787 ts_manager.cc:194] Registered new tserver with Master: 5c3eb2a0e13b4821b559f1c0747d7754 (127.1.126.193:44397)
I20260807 02:19:21.216781 19787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:39627
I20260807 02:19:21.480037 20280 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:21.480372 20280 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:21.483101 19787 ts_manager.cc:194] Registered new tserver with Master: 8b5fef6e86da419fade4d54a2f46afa7 (127.1.126.194:46207)
I20260807 02:19:21.483855 19787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:47845
Aug 07 02:19:21 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069161, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:21.725572 20470 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:21.725908 20470 heartbeater.cc:511] Master 127.1.126.254:36933 requested a full tablet report, sending...
I20260807 02:19:21.726846 19787 ts_manager.cc:194] Registered new tserver with Master: 7db174cecb214414abe7a8535022115f (127.1.126.195:32951)
I20260807 02:19:21.727883 19787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:46249
I20260807 02:19:21.728533 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:19:21.741830 20501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.730692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.1.126.254:36933)
0807 02:19:21.730952 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.730956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.730973 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:19:21.731123 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.731127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.731177 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.731279 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:21.732210 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.733062 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.734229 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.734576 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.734698 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.736449 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:21.736453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:21.736456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:21.736484 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:21.738356 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:21.738907 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:21.738912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:21.738914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:21.739005 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:21.739311 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:21.739315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:21.739317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:21.739533 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:21.739679 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.741522 (+ 1843us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.741655 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":75,"threads_started":1}
I20260807 02:19:21.746230 19787 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:19:21.751717 19787 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 07 02:19:21 dist-test-slave-39l8 krb5kdc[18386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069161, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for HTTP/127.1.126.212@KRBTEST.COM
I20260807 02:19:21.780704 20510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.768912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:32951 (local address 127.0.0.1:44424)
0807 02:19:21.770890 (+ 1978us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:21.770903 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:21.770987 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:21.772810 (+ 1823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:21.772813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:21.772833 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:21.772909 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.772915 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.774305 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.774308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.775628 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.775640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.780102 (+ 4462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.780109 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.780249 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.780299 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 02:19:21.780409 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 02:19:21.780538 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1917,"thread_start_us":83,"threads_started":1}
I20260807 02:19:21.781348 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.769308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44424 (local address 127.1.126.195:32951)
0807 02:19:21.770436 (+ 1128us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.770443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.771085 (+ 642us) server_negotiation.cc:407] Connection header received
0807 02:19:21.771190 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.771196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.771414 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.771553 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:21.773041 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.774156 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.775762 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.776581 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.776693 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.776853 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.781059 (+ 4206us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.781208 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1001,"thread_start_us":122,"threads_started":1}
I20260807 02:19:21.783103 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.768253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:44397 (local address 127.0.0.1:36882)
0807 02:19:21.770574 (+ 2321us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:21.770589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:21.770678 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:21.772514 (+ 1836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:21.772520 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:21.772544 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:21.772692 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.772701 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.778170 (+ 5469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.778174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.779288 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.779300 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.782683 (+ 3383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.782687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.782802 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.782828 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 02:19:21.782908 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 02:19:21.782979 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2261,"thread_start_us":94,"threads_started":1}
I20260807 02:19:21.783627 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.768418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36882 (local address 127.1.126.193:44397)
0807 02:19:21.771848 (+ 3430us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.771854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.771876 (+ 22us) server_negotiation.cc:407] Connection header received
0807 02:19:21.771947 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.771951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.772195 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.772335 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:21.776929 (+ 4594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.778014 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.781677 (+ 3663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.782532 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.782665 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.782838 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.783387 (+ 549us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.783483 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3328,"thread_start_us":139,"threads_started":1}
I20260807 02:19:21.784663 20375 tablet_service.cc:1467] Processing CreateTablet for tablet a2d9b683e3264252aa42f284ce0954b6 (DEFAULT_TABLE table=test-table [id=8adc905247d84347991d0e6512dd8ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:21.785571 20375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d9b683e3264252aa42f284ce0954b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:21.786275 19984 tablet_service.cc:1467] Processing CreateTablet for tablet a2d9b683e3264252aa42f284ce0954b6 (DEFAULT_TABLE table=test-table [id=8adc905247d84347991d0e6512dd8ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:21.787328 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d9b683e3264252aa42f284ce0954b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:21.795204 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.767159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:46207 (local address 127.0.0.1:43636)
0807 02:19:21.769911 (+ 2752us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:21.769962 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:21.770139 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:21.783081 (+ 12942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:21.783085 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:21.783110 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:21.783209 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.783215 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.791512 (+ 8297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.791516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.793662 (+ 2146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.793674 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.794794 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.794798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.794896 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.794923 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:19:21.794987 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 02:19:21.795058 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2566,"thread_start_us":101,"threads_started":1}
I20260807 02:19:21.795938 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.767261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43636 (local address 127.1.126.194:46207)
0807 02:19:21.779606 (+ 12345us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.779614 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.779641 (+ 27us) server_negotiation.cc:407] Connection header received
0807 02:19:21.779719 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.779724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.779946 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.783377 (+ 3431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:21.783520 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.790970 (+ 7450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.793806 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.794579 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.795560 (+ 981us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.795720 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.795762 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.795830 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12215,"thread_start_us":65,"threads_started":1}
I20260807 02:19:21.796001 20517 tablet_bootstrap.cc:492] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754: Bootstrap starting.
I20260807 02:19:21.799556 20163 tablet_service.cc:1467] Processing CreateTablet for tablet a2d9b683e3264252aa42f284ce0954b6 (DEFAULT_TABLE table=test-table [id=8adc905247d84347991d0e6512dd8ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:21.800150 20517 tablet_bootstrap.cc:654] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:21.800621 20163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d9b683e3264252aa42f284ce0954b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:21.801074 20517 log.cc:824] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:21.801860 20516 tablet_bootstrap.cc:492] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Bootstrap starting.
I20260807 02:19:21.804143 20516 tablet_bootstrap.cc:654] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:21.805007 20516 log.cc:824] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:21.807809 20517 tablet_bootstrap.cc:492] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754: No bootstrap required, opened a new log
I20260807 02:19:21.808034 20517 ts_tablet_manager.cc:1397] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260807 02:19:21.813803 20522 tablet_bootstrap.cc:492] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Bootstrap starting.
I20260807 02:19:21.814180 20516 tablet_bootstrap.cc:492] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: No bootstrap required, opened a new log
I20260807 02:19:21.814378 20516 ts_tablet_manager.cc:1397] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260807 02:19:21.817358 20522 tablet_bootstrap.cc:654] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:21.818754 20516 raft_consensus.cc:348] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.819029 20516 raft_consensus.cc:374] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:21.819089 20516 raft_consensus.cc:729] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db174cecb214414abe7a8535022115f, State: Initialized, Role: FOLLOWER
I20260807 02:19:21.819388 20522 log.cc:824] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:21.819653 20517 raft_consensus.cc:348] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.819882 20517 raft_consensus.cc:374] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:21.819933 20517 raft_consensus.cc:729] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3eb2a0e13b4821b559f1c0747d7754, State: Initialized, Role: FOLLOWER
I20260807 02:19:21.820348 20517 consensus_queue.cc:260] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.821749 20517 ts_tablet_manager.cc:1428] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260807 02:19:21.821897 20516 consensus_queue.cc:260] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.822129 20083 heartbeater.cc:503] Master 127.1.126.254:36933 was elected leader, sending a full tablet report...
I20260807 02:19:21.822886 20516 ts_tablet_manager.cc:1428] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Time spent starting tablet: real 0.008s user 0.001s sys 0.007s
I20260807 02:19:21.823251 20470 heartbeater.cc:503] Master 127.1.126.254:36933 was elected leader, sending a full tablet report...
I20260807 02:19:21.826356 20522 tablet_bootstrap.cc:492] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: No bootstrap required, opened a new log
I20260807 02:19:21.826568 20522 ts_tablet_manager.cc:1397] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260807 02:19:21.832643 20522 raft_consensus.cc:348] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.833024 20522 raft_consensus.cc:374] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:21.833150 20522 raft_consensus.cc:729] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b5fef6e86da419fade4d54a2f46afa7, State: Initialized, Role: FOLLOWER
I20260807 02:19:21.833691 20522 consensus_queue.cc:260] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.835466 20522 ts_tablet_manager.cc:1428] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 02:19:21.835906 20280 heartbeater.cc:503] Master 127.1.126.254:36933 was elected leader, sending a full tablet report...
I20260807 02:19:21.846465 20526 raft_consensus.cc:482] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:21.846696 20526 raft_consensus.cc:504] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.848165 20526 leader_election.cc:288] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b5fef6e86da419fade4d54a2f46afa7 (127.1.126.194:46207), 5c3eb2a0e13b4821b559f1c0747d7754 (127.1.126.193:44397)
I20260807 02:19:21.853087 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.848795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:37605 (local address 127.1.126.193:44397)
0807 02:19:21.849133 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.849136 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.849149 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:19:21.849197 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.849199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.849238 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.849335 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:21.849659 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.850383 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.851747 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.852378 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.852512 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.852556 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.852884 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.852956 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262}
I20260807 02:19:21.853107 20533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.848424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:44397 (local address 127.1.126.195:37605)
0807 02:19:21.848739 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:21.848755 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:21.848854 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:21.849348 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:21.849352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:21.849369 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:21.849515 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.849522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.850530 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.850533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.851612 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.851623 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.852619 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.852622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.852747 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.852767 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:19:21.852867 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 02:19:21.852938 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":115,"threads_started":1}
I20260807 02:19:21.853715 20016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9b683e3264252aa42f284ce0954b6" candidate_uuid: "7db174cecb214414abe7a8535022115f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" is_pre_election: true
I20260807 02:19:21.854032 20016 raft_consensus.cc:2454] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7db174cecb214414abe7a8535022115f in term 0.
I20260807 02:19:21.854552 20308 leader_election.cc:302] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c3eb2a0e13b4821b559f1c0747d7754, 7db174cecb214414abe7a8535022115f; no voters:
I20260807 02:19:21.854871 20526 raft_consensus.cc:2781] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:19:21.854980 20526 raft_consensus.cc:482] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:19:21.855036 20526 raft_consensus.cc:3037] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:21.856089 20526 raft_consensus.cc:504] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.856492 20526 leader_election.cc:288] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [CANDIDATE]: Term 1 election: Requested vote from peers 8b5fef6e86da419fade4d54a2f46afa7 (127.1.126.194:46207), 5c3eb2a0e13b4821b559f1c0747d7754 (127.1.126.193:44397)
I20260807 02:19:21.856966 20016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9b683e3264252aa42f284ce0954b6" candidate_uuid: "7db174cecb214414abe7a8535022115f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3eb2a0e13b4821b559f1c0747d7754"
I20260807 02:19:21.857136 20016 raft_consensus.cc:3037] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:21.858197 20016 raft_consensus.cc:2454] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db174cecb214414abe7a8535022115f in term 1.
I20260807 02:19:21.858491 20308 leader_election.cc:302] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c3eb2a0e13b4821b559f1c0747d7754, 7db174cecb214414abe7a8535022115f; no voters:
I20260807 02:19:21.858719 20526 raft_consensus.cc:2781] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:21.858949 20526 raft_consensus.cc:686] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 1 LEADER]: Becoming Leader. State: Replica: 7db174cecb214414abe7a8535022115f, State: Running, Role: LEADER
I20260807 02:19:21.859308 20526 consensus_queue.cc:237] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } }
I20260807 02:19:21.863097 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.849005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:52199 (local address 127.1.126.194:46207)
0807 02:19:21.849158 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.849162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.849177 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:19:21.849226 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.849229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.849275 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.849354 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:21.849738 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.850512 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.861704 (+ 11192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.862296 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.862410 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.862465 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.862859 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.862949 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:19:21.863520 20531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.848313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:46207 (local address 127.1.126.195:52199)
0807 02:19:21.848659 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:21.848676 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:21.848785 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:21.849463 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:21.849466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:21.849482 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:21.849607 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.849613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.860379 (+ 10766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.860382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.861527 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:21.861537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.862570 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.862574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:21.862670 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.862694 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 02:19:21.863309 (+ 615us) client_negotiation.cc:240] Negotiation successful
0807 02:19:21.863388 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":158,"threads_started":1}
I20260807 02:19:21.864357 20204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9b683e3264252aa42f284ce0954b6" candidate_uuid: "7db174cecb214414abe7a8535022115f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b5fef6e86da419fade4d54a2f46afa7" is_pre_election: true
I20260807 02:19:21.864672 20204 raft_consensus.cc:2454] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7db174cecb214414abe7a8535022115f in term 0.
I20260807 02:19:21.864991 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9b683e3264252aa42f284ce0954b6" candidate_uuid: "7db174cecb214414abe7a8535022115f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b5fef6e86da419fade4d54a2f46afa7"
I20260807 02:19:21.865118 20214 raft_consensus.cc:3037] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:21.864796 19787 catalog_manager.cc:5495] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7db174cecb214414abe7a8535022115f (127.1.126.195). New cstate: current_term: 1 leader_uuid: "7db174cecb214414abe7a8535022115f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db174cecb214414abe7a8535022115f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 32951 } health_report { overall_health: HEALTHY } } }
I20260807 02:19:21.866345 20214 raft_consensus.cc:2454] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db174cecb214414abe7a8535022115f in term 1.
I20260807 02:19:21.881331 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.876117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44438 (local address 127.1.126.195:32951)
0807 02:19:21.876242 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:21.876247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:21.876260 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:19:21.876340 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:21.876344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:21.876412 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:21.876523 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:19:21.876942 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.877739 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.879135 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:21.879459 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:21.879572 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:21.880036 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:19:21.880612 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:19:21.880735 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:21.881095 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 02:19:21.881161 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:19:21.890192 20214 raft_consensus.cc:1261] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 1 FOLLOWER]: Refusing update from remote peer 7db174cecb214414abe7a8535022115f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:21.890192 20016 raft_consensus.cc:1261] T a2d9b683e3264252aa42f284ce0954b6 P 5c3eb2a0e13b4821b559f1c0747d7754 [term 1 FOLLOWER]: Refusing update from remote peer 7db174cecb214414abe7a8535022115f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:21.891166 20526 consensus_queue.cc:1035] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3eb2a0e13b4821b559f1c0747d7754" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 44397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:21.892241 20526 consensus_queue.cc:1035] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b5fef6e86da419fade4d54a2f46afa7" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:21.914673 20538 mvcc.cc:205] Tried to move back new op lower bound from 7315739287091392512 to 7315739286978899968. Current Snapshot: MvccSnapshot[applied={T|T < 7315739287091392512}]
I20260807 02:19:21.917145 20539 mvcc.cc:205] Tried to move back new op lower bound from 7315739287091392512 to 7315739286978899968. Current Snapshot: MvccSnapshot[applied={T|T < 7315739287091392512}]
I20260807 02:19:21.926774 19785 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:21.926985 19785 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:21.930052 19785 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8da0d92940714b529335e9fb77aa9efc: Sending DeleteTablet for 3 replicas of tablet a2d9b683e3264252aa42f284ce0954b6
I20260807 02:19:21.931263 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d9b683e3264252aa42f284ce0954b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:21 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:36882
I20260807 02:19:21.932425 20163 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d9b683e3264252aa42f284ce0954b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:21 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:43636
I20260807 02:19:21.932950 20375 tablet_service.cc:1514] Processing DeleteTablet for tablet a2d9b683e3264252aa42f284ce0954b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:21 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:44424
I20260807 02:19:21.934340 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 19841
I20260807 02:19:21.938958 20551 tablet_replica.cc:330] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: stopping tablet replica
I20260807 02:19:21.939352 20551 raft_consensus.cc:2229] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:21.939734 20551 raft_consensus.cc:2258] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:21.940137 20552 tablet_replica.cc:330] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: stopping tablet replica
I20260807 02:19:21.940431 20552 raft_consensus.cc:2229] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:19:21.940828 20552 raft_consensus.cc:2258] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:21.947763 20551 ts_tablet_manager.cc:1905] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:21.948135 20552 ts_tablet_manager.cc:1905] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:21.951031 20552 ts_tablet_manager.cc:1918] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:21.951157 20552 log.cc:1196] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/a2d9b683e3264252aa42f284ce0954b6
I20260807 02:19:21.951504 20552 ts_tablet_manager.cc:1939] T a2d9b683e3264252aa42f284ce0954b6 P 7db174cecb214414abe7a8535022115f: Deleting consensus metadata
I20260807 02:19:21.952183 20551 ts_tablet_manager.cc:1918] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:21.952297 20551 log.cc:1196] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/a2d9b683e3264252aa42f284ce0954b6
I20260807 02:19:21.952672 20551 ts_tablet_manager.cc:1939] T a2d9b683e3264252aa42f284ce0954b6 P 8b5fef6e86da419fade4d54a2f46afa7: Deleting consensus metadata
I20260807 02:19:21.952893 19760 catalog_manager.cc:4841] TS 7db174cecb214414abe7a8535022115f (127.1.126.195:32951): tablet a2d9b683e3264252aa42f284ce0954b6 (table test-table [id=8adc905247d84347991d0e6512dd8ea2]) successfully deleted
I20260807 02:19:21.953888 19760 catalog_manager.cc:4841] TS 8b5fef6e86da419fade4d54a2f46afa7 (127.1.126.194:46207): tablet a2d9b683e3264252aa42f284ce0954b6 (table test-table [id=8adc905247d84347991d0e6512dd8ea2]) successfully deleted
W20260807 02:19:21.974846 19759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:44397 (error 108)
I20260807 02:19:21.976377 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 20089
I20260807 02:19:21.976402 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:21.976097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:44397 (local address 127.0.0.1:36886)
0807 02:19:21.976233 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:21.976312 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:44397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 02:19:21.983196 19759 catalog_manager.cc:4584] TS 5c3eb2a0e13b4821b559f1c0747d7754 (127.1.126.193:44397): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a2d9b683e3264252aa42f284ce0954b6: Network error: Client connection negotiation failed: client connection to 127.1.126.193:44397: connect: Connection refused (error 111)
I20260807 02:19:21.991361 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 20283
I20260807 02:19:22.009011 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 19734
I20260807 02:19:22.023927 1531 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 02:19:22.370071 1531 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 02:19:22.370211 1531 mini_ranger.cc:66] Stopping Ranger...
I20260807 02:19:22.727231 1531 mini_ranger.cc:68] Stopped Ranger
2026-08-07 02:19:22.727 UTC [18424] LOG: received smart shutdown request
2026-08-07 02:19:22.731 UTC [18424] LOG: background worker "logical replication launcher" (PID 18435) exited with exit code 1
2026-08-07 02:19:22.731 UTC [18429] LOG: shutting down
2026-08-07 02:19:22.873 UTC [18424] LOG: database system is shut down
2026-08-07T02:19:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47510 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:19:23 dist-test-slave-39l8 krb5kdc[20565](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:19:23 dist-test-slave-39l8 krb5kdc[20565](info): set up 2 sockets
Aug 07 02:19:23 dist-test-slave-39l8 krb5kdc[20565](info): commencing operation
krb5kdc: starting...
W20260807 02:19:24.205768 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:19:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:19:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:19:24.328939 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45321
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:33889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45321,127.1.126.253:38775,127.1.126.252:46049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:24.438201 20586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:24.438493 20586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:24.438581 20586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:24.442485 20586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:24.442576 20586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:24.442616 20586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:24.442674 20586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:24.442728 20586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:24.447722 20586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:33889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45321,127.1.126.253:38775,127.1.126.252:46049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:24.448699 20586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:24.449648 20586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:24.457834 20595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:24.457840 20593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:24.457834 20597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:24.457957 20586 server_base.cc:1034] running on GCE node
I20260807 02:19:24.458648 20586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:24.459738 20586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:24.460940 20586 hybrid_clock.cc:648] HybridClock initialized: now 1786069164460910 us; error 43 us; skew 500 ppm
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:24.463696 20586 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:24.464576 20586 webserver.cc:460] Webserver started at http://127.1.126.254:44155/ using document root <none> and password file <none>
I20260807 02:19:24.465276 20586 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:24.465380 20586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:24.465634 20586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:24.467734 20586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "d623cf0c492a4931813ef50350eff58f"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "26420851a8e43af084ff70a6b93d57ff"
server_key_iv: "7cc0884ae1a37c36f7eab3aff2c9e341"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.468309 20586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "d623cf0c492a4931813ef50350eff58f"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "26420851a8e43af084ff70a6b93d57ff"
server_key_iv: "7cc0884ae1a37c36f7eab3aff2c9e341"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.471940 20586 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:24.474329 20606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:24.475703 20586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:19:24.475862 20586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "d623cf0c492a4931813ef50350eff58f"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "26420851a8e43af084ff70a6b93d57ff"
server_key_iv: "7cc0884ae1a37c36f7eab3aff2c9e341"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.475976 20586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:24.500450 20586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:24.503460 20586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:24.503666 20586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:24.510388 20586 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45321
I20260807 02:19:24.510459 20691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45321 every 8 connection(s)
I20260807 02:19:24.511412 20586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:24.514111 20692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:24.515507 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 20586
I20260807 02:19:24.515676 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:19:24.515944 1531 external_mini_cluster.cc:1428] Setting key 0c68227b82ce10daaed55a8c93177dd5
I20260807 02:19:24.518064 20692 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.126.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.253@KRBTEST.COM" created.
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:24.534197 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.520664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45321 (local address 127.0.0.1:50246)
0807 02:19:24.521155 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.521208 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.522169 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.523066 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.523070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.523388 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.523659 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.523673 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.525469 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.525472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.526268 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.526278 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.527054 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.527058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.527144 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.527648 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.527664 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.529287 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.531308 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.531318 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.531327 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.531549 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.531877 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.531880 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.531882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.531993 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.532575 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.532581 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.532721 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.532897 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.533287 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":137,"thread_start_us":153,"threads_started":1}
I20260807 02:19:24.534209 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.521596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50246 (local address 127.1.126.254:45321)
0807 02:19:24.521912 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.521925 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.521976 (+ 51us) server_negotiation.cc:407] Connection header received
0807 02:19:24.522502 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.522511 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.522816 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.523024 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.523840 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.525325 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.526410 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.526900 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.527028 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.529442 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.529447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.529456 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.529476 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.531182 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.531662 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.531668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.531669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.531775 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.532097 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.532102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.532103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.532447 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.532590 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.532956 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.533236 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":193,"thread_start_us":92,"threads_started":1}
I20260807 02:19:24.536849 20692 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:19:24.537592 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.537338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42094)
0807 02:19:24.537472 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.537535 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 02:19:24.537863 20611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
I20260807 02:19:24.538679 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.538457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42098)
0807 02:19:24.538578 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.538628 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 02:19:24.538849 20692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:38775: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab.
Entry for principal kudu/127.1.126.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab.
I20260807 02:19:24.543999 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:38775
--webserver_interface=127.1.126.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab
--principal=kudu/127.1.126.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:33889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45321,127.1.126.253:38775,127.1.126.252:46049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:24.588096 20692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } attempt: 1
I20260807 02:19:24.589032 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.588672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42108)
0807 02:19:24.588858 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.588934 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 02:19:24.589783 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.589557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42124)
0807 02:19:24.589663 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.589716 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 02:19:24.589934 20692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:38775: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
W20260807 02:19:24.656572 20703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:24.657034 20703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:24.657145 20703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 02:19:24.658126 20692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } attempt: 2
I20260807 02:19:24.658970 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.658634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42140)
0807 02:19:24.658815 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.658883 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 02:19:24.659689 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.659464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42152)
0807 02:19:24.659576 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.659626 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 02:19:24.659852 20692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:38775: Network error: Client connection negotiation failed: client connection to 127.1.126.253:38775: connect: Connection refused (error 111)
W20260807 02:19:24.661734 20703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:24.661784 20703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:24.661826 20703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:24.661861 20703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:24.661896 20703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:24.667164 20703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:33889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45321,127.1.126.253:38775,127.1.126.252:46049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab
--principal=kudu/127.1.126.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:38775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.126.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:24.668115 20703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:24.669102 20703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:24.677229 20709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:24.677249 20711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:24.677229 20708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:24.677490 20703 server_base.cc:1034] running on GCE node
I20260807 02:19:24.678001 20703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:24.679172 20703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:24.680356 20703 hybrid_clock.cc:648] HybridClock initialized: now 1786069164680344 us; error 23 us; skew 500 ppm
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:24.683164 20703 init.cc:377] Logged in from keytab as kudu/127.1.126.253@KRBTEST.COM (short username kudu)
I20260807 02:19:24.683954 20703 webserver.cc:460] Webserver started at http://127.1.126.253:40147/ using document root <none> and password file <none>
I20260807 02:19:24.684445 20703 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:24.684501 20703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:24.684660 20703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:24.686611 20703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data/instance:
uuid: "75559f40d0cb40af9ebc577d6a777df1"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "29b814070634354eaac45bdd6f658540"
server_key_iv: "98a893b7b20ad51bda0abd24fde2ea8a"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.687229 20703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal/instance:
uuid: "75559f40d0cb40af9ebc577d6a777df1"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "29b814070634354eaac45bdd6f658540"
server_key_iv: "98a893b7b20ad51bda0abd24fde2ea8a"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.690766 20703 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:24.693039 20721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:24.694648 20703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:19:24.694819 20703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal
uuid: "75559f40d0cb40af9ebc577d6a777df1"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "29b814070634354eaac45bdd6f658540"
server_key_iv: "98a893b7b20ad51bda0abd24fde2ea8a"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.694936 20703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:24.712984 20703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:24.716331 20703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:24.716534 20703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:24.723519 20703 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.253:38775
I20260807 02:19:24.723539 20794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.253:38775 every 8 connection(s)
I20260807 02:19:24.724471 20703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
I20260807 02:19:24.727228 20797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:24.730655 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 20703
I20260807 02:19:24.730844 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-1/wal/instance
I20260807 02:19:24.731123 1531 external_mini_cluster.cc:1428] Setting key 03923e2d2c1e1f6480ee71f7454faf6a
I20260807 02:19:24.730929 20797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.126.252@KRBTEST.COM; defaulting to no policy
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.252@KRBTEST.COM" created.
I20260807 02:19:24.745036 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.732832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50258 (local address 127.1.126.254:45321)
0807 02:19:24.732993 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.732998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.733857 (+ 859us) server_negotiation.cc:407] Connection header received
0807 02:19:24.735066 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.735080 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.735150 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.735253 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.736320 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.736855 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.737982 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.738242 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.738360 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.740970 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.740973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.740975 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.740999 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.742558 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.743192 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.743195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.743197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.743271 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.743712 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.743715 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.743716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.743888 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.743958 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.744665 (+ 707us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.744811 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:19:24.745738 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.733179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45321 (local address 127.0.0.1:50258)
0807 02:19:24.733673 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.733734 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.734867 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.735397 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.735402 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.735711 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.736157 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.736181 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.736987 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.736991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.737853 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.737863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.738399 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.738403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.738568 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.739191 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.739206 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.740783 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.742703 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.742709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.742741 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.743067 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.743370 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.743387 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.743392 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.743595 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.743989 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.743998 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.744347 (+ 349us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.744560 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.744878 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":102,"threads_started":1}
I20260807 02:19:24.747267 20797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:19:24.751025 20692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } attempt: 3
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab.
Entry for principal kudu/127.1.126.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab.
I20260807 02:19:24.757371 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.747854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42154)
0807 02:19:24.748283 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.748299 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.748403 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.748752 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.748755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.748921 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.748999 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.749004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.749958 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.749964 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.750472 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.750479 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.751266 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.751270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.751343 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.751839 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.751850 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.753452 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.755637 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.755642 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.755644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.755886 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.756202 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.756207 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.756212 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.756328 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.756847 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.756850 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.756936 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.757057 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.757210 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365}
I20260807 02:19:24.757534 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.747943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42154 (local address 127.1.126.253:38775)
0807 02:19:24.748268 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.748279 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.748375 (+ 96us) server_negotiation.cc:407] Connection header received
0807 02:19:24.748482 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.748488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.748636 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.748771 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.749138 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.749844 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.750582 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.751014 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.751135 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.753619 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.753631 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.753648 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.753675 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.755506 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.755993 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.755999 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.756000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.756085 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.756464 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.756467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.756468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.756696 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.756897 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.757186 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.757314 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":147,"threads_started":1}
I20260807 02:19:24.758303 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:46049
--webserver_interface=127.1.126.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab
--principal=kudu/127.1.126.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:33889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45321,127.1.126.253:38775,127.1.126.252:46049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:24.759449 20797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:19:24.760135 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.759916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50610)
0807 02:19:24.760007 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.760083 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 02:19:24.760339 20727 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
I20260807 02:19:24.761564 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.761322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50626)
0807 02:19:24.761439 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.761495 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 02:19:24.761760 20797 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:46049: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
I20260807 02:19:24.762363 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.751513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42158 (local address 127.1.126.253:38775)
0807 02:19:24.751872 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.751879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.751889 (+ 10us) server_negotiation.cc:407] Connection header received
0807 02:19:24.751915 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.751917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.751948 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.752054 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.752952 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.753584 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.754840 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.755083 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.755236 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.757192 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.757195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.757200 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.757228 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.760311 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.760804 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.760810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.760814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.760910 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.761220 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.761224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.761226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.761433 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.761532 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.762147 (+ 615us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.762238 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":112,"threads_started":1}
I20260807 02:19:24.762495 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.751442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42158)
0807 02:19:24.751545 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.751561 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.751706 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.752077 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.752080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.752237 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.752812 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.752827 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.753707 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.753712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.754652 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.754668 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.755219 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.755223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.755334 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.755755 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.755770 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.757056 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.760433 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.760437 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.760439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.760712 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.761019 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.761021 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.761023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.761099 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.761530 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.761537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.761942 (+ 405us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.762091 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.762246 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 02:19:24.763218 20692 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:19:24.763940 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.763629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50634)
0807 02:19:24.763778 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.763848 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 02:19:24.764647 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.764420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50644)
0807 02:19:24.764560 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.764601 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260807 02:19:24.764868 20692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:46049: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
I20260807 02:19:24.796015 20692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } attempt: 1
I20260807 02:19:24.796830 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.796542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50650)
0807 02:19:24.796700 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.796757 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 02:19:24.797590 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.797319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50654)
0807 02:19:24.797433 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.797500 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 02:19:24.797722 20692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:46049: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
I20260807 02:19:24.811033 20797 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } attempt: 1
I20260807 02:19:24.811758 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.811510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50670)
0807 02:19:24.811638 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.811697 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 02:19:24.812526 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.812320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50676)
0807 02:19:24.812426 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.812472 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 02:19:24.812706 20797 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:46049: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
W20260807 02:19:24.871208 20806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:24.871438 20806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:24.871475 20806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 02:19:24.872874 20692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } attempt: 2
I20260807 02:19:24.873767 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.873430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50678)
0807 02:19:24.873607 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.873676 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 02:19:24.874537 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.874315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50694)
0807 02:19:24.874426 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.874477 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 02:19:24.874684 20692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:46049: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
W20260807 02:19:24.875792 20806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:24.875841 20806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:24.875880 20806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:24.875921 20806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:24.875967 20806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:24.880872 20797 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } attempt: 2
I20260807 02:19:24.881283 20806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:33889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45321,127.1.126.253:38775,127.1.126.252:46049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab
--principal=kudu/127.1.126.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:46049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.126.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:24.881619 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.881308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50706)
0807 02:19:24.881479 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.881556 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 02:19:24.882300 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.882100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50722)
0807 02:19:24.882207 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.882251 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 02:19:24.882476 20806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260807 02:19:24.882663 20797 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:46049: Network error: Client connection negotiation failed: client connection to 127.1.126.252:46049: connect: Connection refused (error 111)
I20260807 02:19:24.883531 20806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:24.891530 20813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:24.891530 20817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:24.891598 20814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:24.891741 20806 server_base.cc:1034] running on GCE node
I20260807 02:19:24.892412 20806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:24.893419 20806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:24.894603 20806 hybrid_clock.cc:648] HybridClock initialized: now 1786069164894579 us; error 42 us; skew 500 ppm
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:24.897363 20806 init.cc:377] Logged in from keytab as kudu/127.1.126.252@KRBTEST.COM (short username kudu)
I20260807 02:19:24.898336 20806 webserver.cc:460] Webserver started at http://127.1.126.252:43807/ using document root <none> and password file <none>
I20260807 02:19:24.899013 20806 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:24.899107 20806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:24.899330 20806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:24.901418 20806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data/instance:
uuid: "b157bc45189f4f21a63ea171bdcf7ddf"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "1da4206852da3a846b8e7181903f0250"
server_key_iv: "2909970ef6d8bc84a647a5a2266c59c0"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.901971 20806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal/instance:
uuid: "b157bc45189f4f21a63ea171bdcf7ddf"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "1da4206852da3a846b8e7181903f0250"
server_key_iv: "2909970ef6d8bc84a647a5a2266c59c0"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.905682 20806 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:19:24.908008 20825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:24.909195 20806 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:19:24.909340 20806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal
uuid: "b157bc45189f4f21a63ea171bdcf7ddf"
format_stamp: "Formatted at 2026-08-07 02:19:24 on dist-test-slave-39l8"
server_key: "1da4206852da3a846b8e7181903f0250"
server_key_iv: "2909970ef6d8bc84a647a5a2266c59c0"
server_key_version: "encryptionkey@0"
I20260807 02:19:24.909453 20806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:24.927989 20806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:24.931219 20806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:24.931425 20806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:24.938225 20806 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.252:46049
I20260807 02:19:24.938299 20894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.252:46049 every 8 connection(s)
I20260807 02:19:24.939193 20806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
I20260807 02:19:24.942337 20895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:24.945755 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 20806
I20260807 02:19:24.945886 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786069003535869-1531-0/minicluster-data/master-2/wal/instance
I20260807 02:19:24.946233 1531 external_mini_cluster.cc:1428] Setting key 378e0a4278f010ae41a45babba15287a
I20260807 02:19:24.947767 20895 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:24.963340 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.951991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50274 (local address 127.1.126.254:45321)
0807 02:19:24.952682 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.952686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.952701 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:19:24.952746 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.952749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.952796 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.952884 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.953864 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.954605 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.955908 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.956205 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.956323 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.959806 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.959812 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.959816 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.959844 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.961320 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.961843 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.961846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.961848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.961931 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.962229 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.962232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.962234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.962423 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.962535 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.963061 (+ 526us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.963180 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593}
I20260807 02:19:24.963485 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.947834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50736 (local address 127.1.126.252:46049)
0807 02:19:24.948323 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.948345 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.948388 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:19:24.949465 (+ 1077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.949490 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.949874 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.951094 (+ 1220us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.951564 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.953302 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.954602 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.955427 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.955583 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.958477 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.958485 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.958500 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.958534 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.960627 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.961068 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.961074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.961080 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.961185 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.961470 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.961474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.961475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.961913 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.962129 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.962429 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.962691 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":315,"thread_start_us":145,"threads_started":1}
I20260807 02:19:24.963483 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.949850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45321 (local address 127.0.0.1:50274)
0807 02:19:24.951489 (+ 1639us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.951538 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.951658 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.952969 (+ 1311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.952978 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.953502 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.953714 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.953725 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.954791 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.954795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.955752 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.955761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.956354 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.956357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.956437 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.957995 (+ 1558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.958018 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.959656 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.961441 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.961452 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.961458 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.961715 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.962027 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.962031 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.962033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.962128 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.962684 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.962690 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.962850 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.962987 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.963169 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1482,"mutex_wait_us":32,"thread_start_us":1410,"threads_started":1}
I20260807 02:19:24.964836 20895 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:24.973559 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.965332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:38775 (local address 127.0.0.1:42170)
0807 02:19:24.965593 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.965604 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.965662 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.965916 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.965919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.966093 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.966164 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.966170 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.967018 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.967020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.967614 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.967624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.968197 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.968201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.968279 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.968741 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.968757 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.970046 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.972079 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.972083 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.972088 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.972287 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.972592 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.972595 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.972597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.972689 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.973065 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.973068 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.973161 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.973277 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.973398 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204}
I20260807 02:19:24.973584 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.965472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42170 (local address 127.1.126.253:38775)
0807 02:19:24.965644 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.965649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.965666 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:19:24.965737 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.965741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.965791 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.965880 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.966318 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.966905 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.967743 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.968068 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.968194 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.970195 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.970198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.970200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.970223 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.971939 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.972392 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.972396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.972398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.972480 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.972785 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.972789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.972791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.972963 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.973081 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.973332 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.973445 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:19:24.973891 20692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } attempt: 3
I20260807 02:19:24.973923 20797 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } attempt: 3
I20260807 02:19:24.974452 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.965956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50284 (local address 127.1.126.254:45321)
0807 02:19:24.966054 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.966057 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.966067 (+ 10us) server_negotiation.cc:407] Connection header received
0807 02:19:24.966100 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.966102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.966132 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.966192 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.966850 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.967363 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.968183 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.968452 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.968563 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.971092 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.971096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.971098 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.971121 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.972458 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.972881 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.972884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.972886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.972971 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.973247 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.973251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.973252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.973419 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.974093 (+ 674us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.974174 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.974284 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 02:19:24.974929 20895 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:19:24 dist-test-slave-39l8 krb5kdc[20565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
I20260807 02:19:24.984555 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.974648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50766)
0807 02:19:24.974788 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.974803 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.974872 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.975630 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.975633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.975818 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.975934 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.975941 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.977047 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.977050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.977898 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.977908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.978503 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.978508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.978593 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.979191 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.979203 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.980717 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.982668 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.982671 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.982673 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.982974 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.983341 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.983346 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.983349 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.983453 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.983937 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.983940 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.984040 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.984152 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.984346 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":23}
I20260807 02:19:24.985018 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.974943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50766 (local address 127.1.126.252:46049)
0807 02:19:24.975377 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.975388 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.975401 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:19:24.975435 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.975437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.975471 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.976047 (+ 576us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.976168 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.976931 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.978024 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.978381 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.979038 (+ 657us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.980850 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.980853 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.980855 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.980876 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.982523 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.983107 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.983111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.983114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.983217 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.983600 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.983603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.983605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.983828 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.983942 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.984223 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.984741 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":354,"thread_start_us":93,"threads_started":1}
I20260807 02:19:24.987232 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.974368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50750)
0807 02:19:24.974468 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.974482 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.974561 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.975016 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.975018 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.975199 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.975289 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.975296 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.976988 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.976992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.977798 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.977809 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.978457 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.978461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.978537 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.979223 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.979238 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.982310 (+ 3072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.985523 (+ 3213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.985526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.985528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.985804 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.986131 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.986136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.986233 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.986682 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.986685 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.986801 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.986904 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.987035 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 02:19:24.987279 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.975582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:46049 (local address 127.0.0.1:50782)
0807 02:19:24.975951 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:24.975967 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:24.976048 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:24.976451 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:24.976454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:24.976618 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:24.976693 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.976699 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.977784 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.977787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.978512 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:24.978520 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.979249 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.979253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:24.979343 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.979780 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:24.979794 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:24.981927 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:24.985685 (+ 3758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.985688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.985689 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.985944 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.986243 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986245 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:24.986247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:24.986329 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:24.986783 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:24.986786 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:24.986875 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 02:19:24.986960 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 02:19:24.987089 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284}
I20260807 02:19:24.987493 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.976464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42182 (local address 127.1.126.253:38775)
0807 02:19:24.976549 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.976553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.976691 (+ 138us) server_negotiation.cc:407] Connection header received
0807 02:19:24.976835 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.976838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.976871 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.976922 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.977735 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.978451 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.979489 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.979848 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.979932 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.983642 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.983645 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.983648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.983672 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.985564 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986060 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.986064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.986065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.986136 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986437 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.986440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.986443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.986623 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.986834 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.987232 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.987334 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":34}
I20260807 02:19:24.987764 20902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.975638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50782 (local address 127.1.126.252:46049)
0807 02:19:24.976244 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.976251 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.976262 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:19:24.976303 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.976307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.976343 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.976780 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.976862 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.977674 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.978646 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.979119 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.979546 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.982044 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.982047 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.982050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.982073 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.985587 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986049 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.986052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.986053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.986130 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986434 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.986437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.986438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.986623 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.987429 (+ 806us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.987497 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.987611 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":552,"thread_start_us":87,"threads_started":1}
I20260807 02:19:24.988497 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.974470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50750 (local address 127.1.126.252:46049)
0807 02:19:24.974780 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.974784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:24.974799 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:19:24.974838 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:24.974841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:24.974881 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:24.974996 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:24.975676 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.976861 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.977917 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:24.978263 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:24.978353 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:24.982618 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:24.982624 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:24.982627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:24.982656 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:24.985399 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.985922 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.985925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.985927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.986009 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:24.986348 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:24.986351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:24.986353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:24.986545 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:24.986636 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:24.988270 (+ 1634us) server_negotiation.cc:299] Negotiation successful
0807 02:19:24.988377 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226}
I20260807 02:19:24.988705 20797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: Bootstrap starting.
I20260807 02:19:24.990787 20692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: Bootstrap starting.
I20260807 02:19:24.991405 20797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:24.992321 20797 log.cc:824] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:24.992944 20692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:24.993387 20895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf: Bootstrap starting.
I20260807 02:19:24.993690 20692 log.cc:824] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:24.994594 20797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: No bootstrap required, opened a new log
I20260807 02:19:24.995951 20692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: No bootstrap required, opened a new log
I20260807 02:19:24.996025 20895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:24.996814 20895 log.cc:824] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:24.997067 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:19:24.998927 20797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.000228 20797 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:25.000306 20797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75559f40d0cb40af9ebc577d6a777df1, State: Initialized, Role: FOLLOWER
I20260807 02:19:25.000797 20797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.001323 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.001535 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.002261 20797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:25.002297 20692 raft_consensus.cc:348] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.002552 20692 raft_consensus.cc:374] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:25.002622 20692 raft_consensus.cc:729] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d623cf0c492a4931813ef50350eff58f, State: Initialized, Role: FOLLOWER
I20260807 02:19:25.003070 20692 consensus_queue.cc:260] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.004186 20692 sys_catalog.cc:564] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: configured and running, proceeding with master startup.
W20260807 02:19:25.005705 20618 tablet.cc:2369] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:19:25.008003 20933 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:19:25.008155 20933 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:19:25.006330 20703 master_runner.cc:186] Error getting master registration for 127.1.126.254:45321: OK, instance_id { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" instance_seqno: 1786069164508557 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 02:19:25.009922 20703 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 02:19:25.012303 20895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf: No bootstrap required, opened a new log
I20260807 02:19:25.011431 20586 master_runner.cc:186] Error getting master registration for 127.1.126.252:46049: OK, instance_id { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" instance_seqno: 1786069164936322 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 02:19:25.014572 20586 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 02:19:25.017673 20895 raft_consensus.cc:348] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.017930 20895 raft_consensus.cc:374] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:25.018000 20895 raft_consensus.cc:729] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b157bc45189f4f21a63ea171bdcf7ddf, State: Initialized, Role: FOLLOWER
I20260807 02:19:25.018520 20895 consensus_queue.cc:260] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.019433 20921 sys_catalog.cc:455] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.019608 20921 sys_catalog.cc:458] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.019846 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.999183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42190 (local address 127.1.126.253:38775)
0807 02:19:24.999288 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.999292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:25.000002 (+ 710us) server_negotiation.cc:407] Connection header received
0807 02:19:25.000463 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:25.000466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:25.000514 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:25.000565 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:25.002697 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:25.003534 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:25.008491 (+ 4957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:25.008818 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:25.008896 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:25.012042 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:25.012046 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:25.012067 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:25.012102 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:25.013959 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:25.016886 (+ 2927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:25.016890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:25.016893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:25.016984 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:25.017746 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:25.017750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:25.017752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:25.018119 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:25.018277 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:25.019564 (+ 1287us) server_negotiation.cc:299] Negotiation successful
0807 02:19:25.019701 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 02:19:25.019922 20895 sys_catalog.cc:564] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:25.020550 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.999210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50290 (local address 127.1.126.254:45321)
0807 02:19:24.999375 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.999380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:25.000263 (+ 883us) server_negotiation.cc:407] Connection header received
0807 02:19:25.001646 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:25.001650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:25.001694 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:25.001744 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:25.004825 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:25.005531 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:25.007328 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:25.007645 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:25.007724 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:25.014480 (+ 6756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:25.014484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:25.014487 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:25.014512 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:25.016301 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:25.017335 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:25.017338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:25.017340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:25.017425 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:25.018585 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:25.018589 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:25.018590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:25.018838 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:25.018967 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:25.020280 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0807 02:19:25.020403 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 02:19:25.025564 20951 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:19:25.025578 20966 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:19:25.025650 20966 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:19:25.025919 20954 sys_catalog.cc:455] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.026036 20954 sys_catalog.cc:458] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.027695 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:24.999814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.1.126.252:46049)
0807 02:19:24.999916 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:24.999920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:25.015061 (+ 15141us) server_negotiation.cc:407] Connection header received
0807 02:19:25.015260 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:25.015263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:25.015313 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:25.015364 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:25.016218 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:25.016986 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:25.018324 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:25.018675 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:25.018783 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:25.021238 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:25.021242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:25.021245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:25.021271 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:25.023064 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:25.026229 (+ 3165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:25.026233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:25.026238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:25.026328 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:25.026653 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:25.026657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:25.026658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:25.026901 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:25.026998 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:25.027416 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 02:19:25.027549 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 02:19:25.028462 20806 master_runner.cc:263] No leader master found from master b157bc45189f4f21a63ea171bdcf7ddf
I20260807 02:19:25.028534 20806 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 02:19:25.029806 20951 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:19:25.129055 20954 raft_consensus.cc:482] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:25.129284 20954 raft_consensus.cc:504] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.130942 20652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d623cf0c492a4931813ef50350eff58f" is_pre_election: true
I20260807 02:19:25.131275 20652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b157bc45189f4f21a63ea171bdcf7ddf in term 0.
I20260807 02:19:25.131722 20828 leader_election.cc:302] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b157bc45189f4f21a63ea171bdcf7ddf, d623cf0c492a4931813ef50350eff58f; no voters:
I20260807 02:19:25.132745 20761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75559f40d0cb40af9ebc577d6a777df1" is_pre_election: true
I20260807 02:19:25.133042 20761 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b157bc45189f4f21a63ea171bdcf7ddf in term 0.
I20260807 02:19:25.133425 20954 leader_election.cc:288] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d623cf0c492a4931813ef50350eff58f (127.1.126.254:45321), 75559f40d0cb40af9ebc577d6a777df1 (127.1.126.253:38775)
I20260807 02:19:25.133702 20954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:19:25.133792 20954 raft_consensus.cc:482] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:19:25.133845 20954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:25.135275 20954 raft_consensus.cc:504] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.135892 20652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d623cf0c492a4931813ef50350eff58f"
I20260807 02:19:25.136022 20652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:25.137784 20652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b157bc45189f4f21a63ea171bdcf7ddf in term 1.
I20260807 02:19:25.138110 20828 leader_election.cc:302] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b157bc45189f4f21a63ea171bdcf7ddf, d623cf0c492a4931813ef50350eff58f; no voters:
I20260807 02:19:25.140985 20761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75559f40d0cb40af9ebc577d6a777df1"
I20260807 02:19:25.141113 20761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:25.142280 20761 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b157bc45189f4f21a63ea171bdcf7ddf in term 1.
I20260807 02:19:25.142637 20954 leader_election.cc:288] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [CANDIDATE]: Term 1 election: Requested vote from peers d623cf0c492a4931813ef50350eff58f (127.1.126.254:45321), 75559f40d0cb40af9ebc577d6a777df1 (127.1.126.253:38775)
I20260807 02:19:25.142810 20954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:25.142895 20954 raft_consensus.cc:686] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [term 1 LEADER]: Becoming Leader. State: Replica: b157bc45189f4f21a63ea171bdcf7ddf, State: Running, Role: LEADER
I20260807 02:19:25.143232 20954 consensus_queue.cc:237] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } }
I20260807 02:19:25.145040 20954 sys_catalog.cc:455] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: SysCatalogTable state changed. Reason: New leader b157bc45189f4f21a63ea171bdcf7ddf. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.145148 20954 sys_catalog.cc:458] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:25.146920 20973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:25.147888 20973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:25.153257 20761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [term 1 FOLLOWER]: Refusing update from remote peer b157bc45189f4f21a63ea171bdcf7ddf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:25.156390 20970 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [LEADER]: Connected to new peer: Peer: permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:25.160971 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b157bc45189f4f21a63ea171bdcf7ddf. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.161100 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.162326 20652 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [term 1 FOLLOWER]: Refusing update from remote peer b157bc45189f4f21a63ea171bdcf7ddf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:25.162988 20970 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:25.167050 20921 sys_catalog.cc:455] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b157bc45189f4f21a63ea171bdcf7ddf. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.167197 20921 sys_catalog.cc:458] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.170209 20970 sys_catalog.cc:455] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.170337 20970 sys_catalog.cc:458] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:25.171667 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.171794 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.171942 20975 mvcc.cc:205] Tried to move back new op lower bound from 7315739300460179456 to 7315739300429848576. Current Snapshot: MvccSnapshot[applied={T|T < 7315739300460179456}]
I20260807 02:19:25.172211 20974 mvcc.cc:205] Tried to move back new op lower bound from 7315739300460179456 to 7315739300429848576. Current Snapshot: MvccSnapshot[applied={T|T < 7315739300460179456}]
I20260807 02:19:25.178921 20954 sys_catalog.cc:455] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.179047 20954 sys_catalog.cc:458] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:25.180200 20921 sys_catalog.cc:455] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d623cf0c492a4931813ef50350eff58f" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45321 } } peers { permanent_uuid: "75559f40d0cb40af9ebc577d6a777df1" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 38775 } } peers { permanent_uuid: "b157bc45189f4f21a63ea171bdcf7ddf" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 46049 } } }
I20260807 02:19:25.180351 20921 sys_catalog.cc:458] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:19:25.180887 20973 catalog_manager.cc:1347] Generated new cluster ID: 62d661759f8445a983fce776c11893a8
I20260807 02:19:25.180951 20973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:25.191656 20978 mvcc.cc:205] Tried to move back new op lower bound from 7315739300460179456 to 7315739300429848576. Current Snapshot: MvccSnapshot[applied={T|T < 7315739300460179456 or (T in {7315739300460179456})}]
I20260807 02:19:25.211526 20973 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:19:25.212873 20973 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:25.228289 20973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b157bc45189f4f21a63ea171bdcf7ddf: Generated new TSK 0
I20260807 02:19:25.229189 20973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:19:26.009611 20933 catalog_manager.cc:1259] Loaded cluster ID: 62d661759f8445a983fce776c11893a8
I20260807 02:19:26.009728 20933 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: loading cluster ID for follower catalog manager: success
I20260807 02:19:26.011620 20933 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: acquiring CA information for follower catalog manager: success
I20260807 02:19:26.013427 20933 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 75559f40d0cb40af9ebc577d6a777df1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 02:19:26.031235 20951 catalog_manager.cc:1259] Loaded cluster ID: 62d661759f8445a983fce776c11893a8
I20260807 02:19:26.031302 20951 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: loading cluster ID for follower catalog manager: success
I20260807 02:19:26.032866 20951 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: acquiring CA information for follower catalog manager: success
I20260807 02:19:26.033938 20951 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d623cf0c492a4931813ef50350eff58f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 02:19:26.292531 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 20586
I20260807 02:19:26.308097 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 20703
I20260807 02:19:26.319455 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 20806
2026-08-07T02:19:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3330 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:19:26 dist-test-slave-39l8 krb5kdc[20992](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:19:26 dist-test-slave-39l8 krb5kdc[20992](info): set up 2 sockets
Aug 07 02:19:26 dist-test-slave-39l8 krb5kdc[20992](info): commencing operation
krb5kdc: starting...
W20260807 02:19:27.532248 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:19:27 dist-test-slave-39l8 krb5kdc[20992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:19:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:19:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:19:27.653795 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42483
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:32925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:42483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:27.766034 21008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:27.766326 21008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:27.766407 21008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:27.770358 21008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:27.770445 21008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:27.770484 21008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:27.770542 21008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:27.770582 21008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:27.775784 21008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:32925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:42483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:27.776782 21008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:27.777770 21008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:27.786096 21018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:27.786155 21008 server_base.cc:1034] running on GCE node
W20260807 02:19:27.786166 21014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:27.786352 21013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:27.786998 21008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:27.788013 21008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:27.789199 21008 hybrid_clock.cc:648] HybridClock initialized: now 1786069167789172 us; error 41 us; skew 500 ppm
Aug 07 02:19:27 dist-test-slave-39l8 krb5kdc[20992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:27.791855 21008 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:27.792692 21008 webserver.cc:460] Webserver started at http://127.1.126.254:41971/ using document root <none> and password file <none>
I20260807 02:19:27.793237 21008 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:27.793330 21008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:27.793555 21008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:27.795531 21008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "6959f742bd3343a2a86deb91f98277d5"
format_stamp: "Formatted at 2026-08-07 02:19:27 on dist-test-slave-39l8"
server_key: "6bead1c5faf84a81f71ad3d4e9510fdb"
server_key_iv: "fa165c7988b293815d97fb82f131ac15"
server_key_version: "encryptionkey@0"
I20260807 02:19:27.796078 21008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "6959f742bd3343a2a86deb91f98277d5"
format_stamp: "Formatted at 2026-08-07 02:19:27 on dist-test-slave-39l8"
server_key: "6bead1c5faf84a81f71ad3d4e9510fdb"
server_key_iv: "fa165c7988b293815d97fb82f131ac15"
server_key_version: "encryptionkey@0"
I20260807 02:19:27.799515 21008 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:27.801752 21027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:27.802968 21008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:19:27.803100 21008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "6959f742bd3343a2a86deb91f98277d5"
format_stamp: "Formatted at 2026-08-07 02:19:27 on dist-test-slave-39l8"
server_key: "6bead1c5faf84a81f71ad3d4e9510fdb"
server_key_iv: "fa165c7988b293815d97fb82f131ac15"
server_key_version: "encryptionkey@0"
I20260807 02:19:27.803210 21008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:27.813927 21008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:27.816504 21008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:27.816702 21008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:27.823417 21008 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:42483
I20260807 02:19:27.823446 21100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:42483 every 8 connection(s)
I20260807 02:19:27.824373 21008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:27.826974 21102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:27.829986 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21008
I20260807 02:19:27.830155 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:19:27.830417 1531 external_mini_cluster.cc:1428] Setting key 41c0fbefd0d260abdd30f9fec37b25f1
I20260807 02:19:27.832583 21102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5: Bootstrap starting.
I20260807 02:19:27.835114 21102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:27.835980 21102 log.cc:824] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:27.838079 21102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5: No bootstrap required, opened a new log
Aug 07 02:19:27 dist-test-slave-39l8 krb5kdc[20992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:27.842353 21102 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6959f742bd3343a2a86deb91f98277d5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42483 } }
I20260807 02:19:27.842631 21102 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:27.842728 21102 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6959f742bd3343a2a86deb91f98277d5, State: Initialized, Role: FOLLOWER
I20260807 02:19:27.843253 21102 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6959f742bd3343a2a86deb91f98277d5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42483 } }
I20260807 02:19:27.843427 21102 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:27.843501 21102 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:27.843607 21102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:27.844815 21102 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6959f742bd3343a2a86deb91f98277d5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42483 } }
I20260807 02:19:27.845171 21102 leader_election.cc:302] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6959f742bd3343a2a86deb91f98277d5; no voters:
I20260807 02:19:27.845592 21102 leader_election.cc:288] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:19:27.845723 21110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:27.845954 21105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:27.831670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.1.126.254:42483)
0807 02:19:27.832064 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:27.832080 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:27.832115 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:19:27.832767 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:27.832785 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:27.833089 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:27.833344 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:27.834298 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:27.835352 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:27.836464 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:27.837016 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:27.837136 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:27.839923 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:27.839929 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:27.839964 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:27.839997 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:27.842554 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:27.843101 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:27.843106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:27.843112 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:27.843255 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:27.843597 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:27.843600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:27.843603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:27.844120 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:27.844353 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:27.844569 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 02:19:27.844888 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":119,"threads_started":1}
I20260807 02:19:27.845978 21110 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [term 1 LEADER]: Becoming Leader. State: Replica: 6959f742bd3343a2a86deb91f98277d5, State: Running, Role: LEADER
I20260807 02:19:27.846904 21102 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:27.847508 21110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6959f742bd3343a2a86deb91f98277d5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42483 } }
I20260807 02:19:27.849326 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:19:27.849457 21113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6959f742bd3343a2a86deb91f98277d5. Latest consensus state: current_term: 1 leader_uuid: "6959f742bd3343a2a86deb91f98277d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6959f742bd3343a2a86deb91f98277d5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42483 } } }
I20260807 02:19:27.849387 21111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6959f742bd3343a2a86deb91f98277d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6959f742bd3343a2a86deb91f98277d5" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42483 } } }
I20260807 02:19:27.849844 21111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:27.849844 21113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5 [sys.catalog]: This master's current role is: LEADER
W20260807 02:19:27.851990 21134 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:19:27.852105 21134 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:19:27.852192 21138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:27.852880 21138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:27.857604 21138 catalog_manager.cc:1347] Generated new cluster ID: 1e503f80b8ab4e64aa3b51cce4d3c2b6
I20260807 02:19:27.857666 21138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:27.881912 21138 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:19:27.883155 21138 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:27.888537 21138 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6959f742bd3343a2a86deb91f98277d5: Generated new TSK 0
I20260807 02:19:27.889284 21138 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:19:27.905382 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21008
2026-08-07T02:19:27Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1585 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:19:27 dist-test-slave-39l8 krb5kdc[21148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:19:27 dist-test-slave-39l8 krb5kdc[21148](info): set up 2 sockets
Aug 07 02:19:27 dist-test-slave-39l8 krb5kdc[21148](info): commencing operation
krb5kdc: starting...
W20260807 02:19:29.100498 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:19:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:19:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:19:29.221141 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36675
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:29.331102 21164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:29.331379 21164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:29.331445 21164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:29.335508 21164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:29.335601 21164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:29.335636 21164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:29.335678 21164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:29.335714 21164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:29.340857 21164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:29.341885 21164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:29.342917 21164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:29.351251 21171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:29.351284 21170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:29.351284 21173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:29.351493 21164 server_base.cc:1034] running on GCE node
I20260807 02:19:29.352094 21164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:29.353120 21164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:29.354298 21164 hybrid_clock.cc:648] HybridClock initialized: now 1786069169354264 us; error 30 us; skew 500 ppm
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:29.357046 21164 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:29.357924 21164 webserver.cc:460] Webserver started at http://127.1.126.254:44473/ using document root <none> and password file <none>
I20260807 02:19:29.358430 21164 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:29.358487 21164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:29.358657 21164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:29.360607 21164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "62c024bf11974bbb92fded67fda024c0"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "97b95b6f739515c19fe0adcf85e3f990"
server_key_iv: "f3929a723fa73d6501ca0f47e5559578"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.361115 21164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "62c024bf11974bbb92fded67fda024c0"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "97b95b6f739515c19fe0adcf85e3f990"
server_key_iv: "f3929a723fa73d6501ca0f47e5559578"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.364629 21164 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:19:29.366989 21182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.368435 21164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:29.368547 21164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "62c024bf11974bbb92fded67fda024c0"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "97b95b6f739515c19fe0adcf85e3f990"
server_key_iv: "f3929a723fa73d6501ca0f47e5559578"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.368630 21164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:29.387199 21164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:29.389853 21164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:29.390019 21164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:29.397066 21164 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36675
I20260807 02:19:29.397367 21266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36675 every 8 connection(s)
I20260807 02:19:29.398023 21164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:29.400655 21267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:29.405875 21267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap starting.
I20260807 02:19:29.407074 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21164
I20260807 02:19:29.407182 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:19:29.407471 1531 external_mini_cluster.cc:1428] Setting key bd93714559bf3febb5ca87e5afc9d3ba
I20260807 02:19:29.408511 21267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:29.409240 21267 log.cc:824] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:29.411299 21267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: No bootstrap required, opened a new log
I20260807 02:19:29.414525 21267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:29.414865 21267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:29.414949 21267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62c024bf11974bbb92fded67fda024c0, State: Initialized, Role: FOLLOWER
I20260807 02:19:29.415443 21267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:29.415609 21267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:29.415694 21267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:29.415813 21267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:29.416811 21267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:29.417150 21267 leader_election.cc:302] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62c024bf11974bbb92fded67fda024c0; no voters:
I20260807 02:19:29.417522 21267 leader_election.cc:288] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:19:29.417574 21272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:29.417771 21272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 LEADER]: Becoming Leader. State: Replica: 62c024bf11974bbb92fded67fda024c0, State: Running, Role: LEADER
I20260807 02:19:29.418092 21272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:29.418689 21267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:29.419646 21273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62c024bf11974bbb92fded67fda024c0. Latest consensus state: current_term: 1 leader_uuid: "62c024bf11974bbb92fded67fda024c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } } }
I20260807 02:19:29.419773 21273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:29.419866 21274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62c024bf11974bbb92fded67fda024c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } } }
I20260807 02:19:29.419978 21274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:29.420396 21282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:29.422806 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:29.408574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.1.126.254:36675)
0807 02:19:29.409046 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:29.409061 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:29.409094 (+ 33us) server_negotiation.cc:407] Connection header received
0807 02:19:29.409746 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:29.409763 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:29.410046 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:29.410310 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:29.411207 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.412239 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.413399 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.414480 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.414597 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:29.417511 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:29.417524 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:29.417536 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:29.417562 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:29.419627 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:29.420169 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:29.420175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:29.420181 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:29.420318 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:29.420662 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:29.420666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:29.420668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:29.421137 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:29.421326 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:29.421609 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 02:19:29.421890 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":167,"threads_started":1}
I20260807 02:19:29.423700 21282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:29.429255 21282 catalog_manager.cc:1347] Generated new cluster ID: cc5bef97169842fe993cadf1a6cd6314
I20260807 02:19:29.429335 21282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:29.449152 21282 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:19:29.449954 21282 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:29.456503 21282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Generated new TSK 0
I20260807 02:19:29.457113 21282 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:19:29.493412 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36675
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:29.614980 21299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:29.615231 21299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:29.615296 21299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:29.619098 21299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:29.619143 21299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:29.619225 21299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:19:29.624074 21299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:29.625005 21299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:29.625982 21299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:29.635229 21306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:29.635248 21308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:29.635249 21305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:29.635460 21299 server_base.cc:1034] running on GCE node
I20260807 02:19:29.635859 21299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:29.636409 21299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:29.637575 21299 hybrid_clock.cc:648] HybridClock initialized: now 1786069169637560 us; error 25 us; skew 500 ppm
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:29.640245 21299 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:19:29.641027 21299 webserver.cc:460] Webserver started at http://127.1.126.193:46349/ using document root <none> and password file <none>
I20260807 02:19:29.641732 21299 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:29.641820 21299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:29.642058 21299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:29.643963 21299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "cba95a7085104eb988dda6fc2d029a57"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "ad18b2fcfa079e4f2a16ff11762b0d17"
server_key_iv: "8fbabe601861df2128636b6d47285322"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.644454 21299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "cba95a7085104eb988dda6fc2d029a57"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "ad18b2fcfa079e4f2a16ff11762b0d17"
server_key_iv: "8fbabe601861df2128636b6d47285322"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.647789 21299 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:29.650116 21317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.651273 21299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:19:29.651391 21299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "cba95a7085104eb988dda6fc2d029a57"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "ad18b2fcfa079e4f2a16ff11762b0d17"
server_key_iv: "8fbabe601861df2128636b6d47285322"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.651499 21299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:29.662971 21299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:29.665982 21299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:29.666157 21299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:29.666666 21299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:29.667459 21299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:29.667505 21299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.667577 21299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:29.667608 21299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.675985 21299 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:33785
I20260807 02:19:29.676061 21474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:33785 every 8 connection(s)
I20260807 02:19:29.676842 21299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:19:29.680025 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21299
I20260807 02:19:29.680183 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:19:29.680451 1531 external_mini_cluster.cc:1428] Setting key 873298d6d02db465003cd53b5c01273d
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:19:29.691238 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:29.678519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38593 (local address 127.1.126.254:36675)
0807 02:19:29.678660 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:29.678664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:29.679454 (+ 790us) server_negotiation.cc:407] Connection header received
0807 02:19:29.680908 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:29.680912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:29.680974 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:29.681081 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:29.682387 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.683021 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.684585 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.684830 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.684946 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:29.687727 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:29.687731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:29.687733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:29.687759 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:29.689134 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:29.689630 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:29.689639 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:29.689641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:29.689717 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:29.690070 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:29.690075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:29.690077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:29.690253 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:29.690363 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:29.690882 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 02:19:29.691012 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:19:29.691905 21478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:29.678902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:38593)
0807 02:19:29.679317 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:29.679356 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:29.680678 (+ 1322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:29.681252 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:29.681259 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:29.681604 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:29.682209 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:29.682230 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.683154 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.683160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:29.684455 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:29.684465 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.684992 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.684996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:29.685153 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:29.685692 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:29.685708 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:29.687546 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:29.689256 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:29.689262 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:29.689275 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:29.689518 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:29.689811 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:29.689814 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:29.689816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:29.689969 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:29.690363 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:29.690371 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:29.690591 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 02:19:29.690830 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 02:19:29.691071 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":105,"threads_started":1}
I20260807 02:19:29.693143 21475 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36675
I20260807 02:19:29.693388 21475 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:19:29.693949 21475 heartbeater.cc:511] Master 127.1.126.254:36675 requested a full tablet report, sending...
I20260807 02:19:29.695643 21208 ts_manager.cc:194] Registered new tserver with Master: cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785)
I20260807 02:19:29.696745 21208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:38593
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:19:29.707290 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36675
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:29.817696 21482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:29.817930 21482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:29.817970 21482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:29.821930 21482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:29.821986 21482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:29.822039 21482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:19:29.826992 21482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:29.827867 21482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:29.828907 21482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:29.838238 21488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:29.838274 21492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:29.838364 21482 server_base.cc:1034] running on GCE node
W20260807 02:19:29.838248 21489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:29.838909 21482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:29.839463 21482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:29.840657 21482 hybrid_clock.cc:648] HybridClock initialized: now 1786069169840639 us; error 48 us; skew 500 ppm
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:29.843351 21482 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:19:29.844118 21482 webserver.cc:460] Webserver started at http://127.1.126.194:44035/ using document root <none> and password file <none>
I20260807 02:19:29.844628 21482 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:29.844687 21482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:29.844848 21482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:29.846846 21482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "fe460110f045475cbdacef3faa77a3cf"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "a2d4f54ffd13661d8a0ad91f351198f3"
server_key_iv: "b184b98242c5e5c23bc85b3c7ff0fcd4"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.847340 21482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "fe460110f045475cbdacef3faa77a3cf"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "a2d4f54ffd13661d8a0ad91f351198f3"
server_key_iv: "b184b98242c5e5c23bc85b3c7ff0fcd4"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.850812 21482 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:29.853060 21501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.854197 21482 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:29.854318 21482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "fe460110f045475cbdacef3faa77a3cf"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "a2d4f54ffd13661d8a0ad91f351198f3"
server_key_iv: "b184b98242c5e5c23bc85b3c7ff0fcd4"
server_key_version: "encryptionkey@0"
I20260807 02:19:29.854398 21482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:29.883416 21482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:29.886154 21482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:29.886307 21482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:29.886912 21482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:29.887789 21482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:29.887837 21482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.887877 21482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:29.887908 21482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:29.896945 21482 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42869
I20260807 02:19:29.896971 21653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42869 every 8 connection(s)
I20260807 02:19:29.897773 21482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:19:29.903594 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21482
I20260807 02:19:29.903729 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:19:29.904037 1531 external_mini_cluster.cc:1428] Setting key 88fedf65d7394c37a020f3351f3bb2d9
Aug 07 02:19:29 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069169, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:29.911293 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:29.899522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:49623 (local address 127.1.126.254:36675)
0807 02:19:29.899661 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:29.899665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:29.900397 (+ 732us) server_negotiation.cc:407] Connection header received
0807 02:19:29.901542 (+ 1145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:29.901545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:29.901592 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:29.901664 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:29.902766 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.903300 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.904797 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.905015 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.905094 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:29.907656 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:29.907663 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:29.907668 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:29.907702 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:29.909080 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:29.909602 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:29.909608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:29.909621 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:29.909716 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:29.910044 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:29.910050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:29.910054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:29.910300 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:29.910406 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:29.910909 (+ 503us) server_negotiation.cc:299] Negotiation successful
0807 02:19:29.911075 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:19:29.912038 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:29.899811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:49623)
0807 02:19:29.900240 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:29.900280 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:29.901350 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:29.901820 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:29.901826 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:29.902161 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:29.902582 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:29.902594 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.903443 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.903447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:29.904681 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:29.904691 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:29.905162 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:29.905165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:29.905346 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:29.905860 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:29.905878 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:29.907487 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:29.909223 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:29.909227 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:29.909237 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:29.909499 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:29.909809 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:29.909811 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:29.909813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:29.909931 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:29.910407 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:29.910412 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:29.910611 (+ 199us) client_negotiation.cc:769] Sending connection context
0807 02:19:29.910856 (+ 245us) client_negotiation.cc:240] Negotiation successful
0807 02:19:29.911208 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":108,"threads_started":1}
I20260807 02:19:29.913203 21654 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36675
I20260807 02:19:29.913453 21654 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:29.914026 21654 heartbeater.cc:511] Master 127.1.126.254:36675 requested a full tablet report, sending...
I20260807 02:19:29.915203 21208 ts_manager.cc:194] Registered new tserver with Master: fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869)
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:19:29.915802 21208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:49623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:19:29.932879 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36675
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:30.049947 21660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:30.050201 21660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:30.050259 21660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:30.054121 21660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:30.054172 21660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:30.054239 21660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:19:30.059626 21660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:30.060542 21660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:30.061496 21660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:30.070935 21671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.070930 21667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:30.071080 21660 server_base.cc:1034] running on GCE node
W20260807 02:19:30.070930 21669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:30.071652 21660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:30.072378 21660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:30.073549 21660 hybrid_clock.cc:648] HybridClock initialized: now 1786069170073517 us; error 44 us; skew 500 ppm
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:30.076232 21660 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:19:30.077068 21660 webserver.cc:460] Webserver started at http://127.1.126.195:37267/ using document root <none> and password file <none>
I20260807 02:19:30.077632 21660 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:30.077720 21660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:30.077950 21660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:30.079967 21660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "dd0007eecf844647999a4d5887394920"
format_stamp: "Formatted at 2026-08-07 02:19:30 on dist-test-slave-39l8"
server_key: "16375f947b4d5e6d6d8bef672b542c56"
server_key_iv: "71463c7e502767ed2af15df09e1f156e"
server_key_version: "encryptionkey@0"
I20260807 02:19:30.080534 21660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "dd0007eecf844647999a4d5887394920"
format_stamp: "Formatted at 2026-08-07 02:19:30 on dist-test-slave-39l8"
server_key: "16375f947b4d5e6d6d8bef672b542c56"
server_key_iv: "71463c7e502767ed2af15df09e1f156e"
server_key_version: "encryptionkey@0"
I20260807 02:19:30.084089 21660 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:30.086535 21691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:30.087747 21660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:30.087883 21660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "dd0007eecf844647999a4d5887394920"
format_stamp: "Formatted at 2026-08-07 02:19:30 on dist-test-slave-39l8"
server_key: "16375f947b4d5e6d6d8bef672b542c56"
server_key_iv: "71463c7e502767ed2af15df09e1f156e"
server_key_version: "encryptionkey@0"
I20260807 02:19:30.087992 21660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:30.107295 21660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:30.110239 21660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:30.110455 21660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:30.111153 21660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:30.112097 21660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:30.112183 21660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:30.112277 21660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:30.112326 21660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:30.121224 21660 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:41831
I20260807 02:19:30.121266 21837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:41831 every 8 connection(s)
I20260807 02:19:30.122128 21660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:19:30.128954 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21660
I20260807 02:19:30.129086 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:19:30.129379 1531 external_mini_cluster.cc:1428] Setting key 3c1d75be5167744747a1c54d017e067c
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:30.136034 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.124033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:54627 (local address 127.1.126.254:36675)
0807 02:19:30.124179 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.124183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.124991 (+ 808us) server_negotiation.cc:407] Connection header received
0807 02:19:30.126297 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.126301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.126361 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.126465 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:30.127693 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.128222 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.129778 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.130065 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.130197 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.132688 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:30.132692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:30.132695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:30.132721 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:30.133993 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.134502 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.134505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.134507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.134592 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.134958 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.134963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.134964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.135149 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:30.135269 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.135745 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.135867 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:19:30.136751 21842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.124405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:54627)
0807 02:19:30.124846 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.124887 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.126065 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.126641 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.126647 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.127080 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:30.127541 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.127555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.128360 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.128364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.129640 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.129652 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.130225 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.130230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.130399 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.131113 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:30.131129 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:30.132526 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:30.134112 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:30.134118 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:30.134131 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:30.134385 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:30.134716 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:30.134722 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:30.134724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:30.134857 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:30.135269 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:30.135277 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:30.135507 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.135689 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.135988 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260807 02:19:30.137794 21839 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36675
I20260807 02:19:30.138038 21839 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:30.138509 21839 heartbeater.cc:511] Master 127.1.126.254:36675 requested a full tablet report, sending...
I20260807 02:19:30.139534 21208 ts_manager.cc:194] Registered new tserver with Master: dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
I20260807 02:19:30.140079 21208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:54627
I20260807 02:19:30.143266 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:19:30.152698 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.145168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.1.126.254:36675)
0807 02:19:30.145304 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.145310 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.145523 (+ 213us) server_negotiation.cc:407] Connection header received
0807 02:19:30.145666 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.145669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.145708 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.145794 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:30.146476 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.147050 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.147927 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.148151 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.148256 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.149628 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:30.149632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:30.149635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:30.149664 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:30.151017 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.151441 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.151445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.151447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.151526 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.151816 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.151820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.151821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.152042 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:30.152195 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.152430 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.152541 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:19:30.155328 21208 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:19:30.158516 21208 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:19:30.173228 21855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.166731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.1.126.193:33785)
0807 02:19:30.167328 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.167345 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.167533 (+ 188us) server_negotiation.cc:407] Connection header received
0807 02:19:30.167786 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.167791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.168003 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.168145 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:30.168793 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.169966 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.171849 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.172568 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.172693 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.172839 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.172984 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.173084 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":70,"threads_started":1}
I20260807 02:19:30.173215 21853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.166601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33785 (local address 127.0.0.1:37296)
0807 02:19:30.167398 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.167446 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.167600 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.168378 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.168383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.168425 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:30.168653 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.168660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.170126 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.170129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.171706 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.171712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.172696 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.172700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.172804 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.172839 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.172953 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.173070 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":179,"thread_start_us":84,"threads_started":1}
I20260807 02:19:30.173398 21856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.166695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:41831 (local address 127.0.0.1:35940)
0807 02:19:30.167468 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.167482 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.167600 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.168457 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.168460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.168473 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:30.168653 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.168660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.170408 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.170415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.171511 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.171521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.172913 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.172917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.173113 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.173135 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.173207 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.173255 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":52,"thread_start_us":93,"threads_started":1}
I20260807 02:19:30.173591 21859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.167433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60336 (local address 127.1.126.194:42869)
0807 02:19:30.167842 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.167857 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.168761 (+ 904us) server_negotiation.cc:407] Connection header received
0807 02:19:30.168894 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.168898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.169025 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.169184 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:30.169372 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.170121 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.171825 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.172604 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.172719 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.172844 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.173334 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.173428 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":110,"threads_started":1}
I20260807 02:19:30.173854 21854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.167052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42869 (local address 127.0.0.1:60336)
0807 02:19:30.168645 (+ 1593us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.168656 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.168774 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.169162 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.169165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.169184 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:30.169275 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.169282 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.170252 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.170254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.171696 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.171710 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.172913 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.172917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.173079 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.173107 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.173182 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.173255 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1539,"mutex_wait_us":163,"thread_start_us":100,"threads_started":1}
I20260807 02:19:30.174387 21857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.167445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35940 (local address 127.1.126.195:41831)
0807 02:19:30.167999 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.168007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.168046 (+ 39us) server_negotiation.cc:407] Connection header received
0807 02:19:30.168123 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.168128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.168324 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.168451 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:30.168793 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.169966 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.171632 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.172601 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.172713 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.172843 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.174149 (+ 1306us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.174254 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":102,"threads_started":1}
I20260807 02:19:30.176672 21751 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 (DEFAULT_TABLE table=test-table [id=cb97e6f104eb43e09df3906bc2a96fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:30.176676 21384 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 (DEFAULT_TABLE table=test-table [id=cb97e6f104eb43e09df3906bc2a96fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:30.176676 21563 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 (DEFAULT_TABLE table=test-table [id=cb97e6f104eb43e09df3906bc2a96fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:30.177559 21751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa61836d13b48ac8b0fef5655ca7411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:30.177675 21384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa61836d13b48ac8b0fef5655ca7411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:30.177675 21563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa61836d13b48ac8b0fef5655ca7411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:30.184000 21860 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Bootstrap starting.
I20260807 02:19:30.184996 21861 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Bootstrap starting.
I20260807 02:19:30.185364 21863 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Bootstrap starting.
I20260807 02:19:30.186050 21860 tablet_bootstrap.cc:654] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:30.187202 21860 log.cc:824] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:30.187628 21863 tablet_bootstrap.cc:654] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:30.188493 21863 log.cc:824] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:30.188911 21861 tablet_bootstrap.cc:654] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:30.189456 21860 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: No bootstrap required, opened a new log
I20260807 02:19:30.189651 21860 ts_tablet_manager.cc:1397] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:19:30.190165 21861 log.cc:824] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:30.190604 21863 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: No bootstrap required, opened a new log
I20260807 02:19:30.190812 21863 ts_tablet_manager.cc:1397] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:19:30.191936 21861 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: No bootstrap required, opened a new log
I20260807 02:19:30.192168 21861 ts_tablet_manager.cc:1397] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 02:19:30.193591 21860 raft_consensus.cc:348] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.193878 21860 raft_consensus.cc:374] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:30.193969 21860 raft_consensus.cc:729] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0007eecf844647999a4d5887394920, State: Initialized, Role: FOLLOWER
I20260807 02:19:30.194448 21860 consensus_queue.cc:260] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.194563 21863 raft_consensus.cc:348] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.194870 21863 raft_consensus.cc:374] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:30.194952 21863 raft_consensus.cc:729] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe460110f045475cbdacef3faa77a3cf, State: Initialized, Role: FOLLOWER
I20260807 02:19:30.195185 21839 heartbeater.cc:503] Master 127.1.126.254:36675 was elected leader, sending a full tablet report...
I20260807 02:19:30.195214 21861 raft_consensus.cc:348] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.195423 21861 raft_consensus.cc:374] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:30.195468 21861 raft_consensus.cc:729] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cba95a7085104eb988dda6fc2d029a57, State: Initialized, Role: FOLLOWER
I20260807 02:19:30.195726 21863 consensus_queue.cc:260] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.195910 21860 ts_tablet_manager.cc:1428] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:19:30.195932 21861 consensus_queue.cc:260] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.196413 21654 heartbeater.cc:503] Master 127.1.126.254:36675 was elected leader, sending a full tablet report...
I20260807 02:19:30.196593 21863 ts_tablet_manager.cc:1428] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:19:30.196769 21861 ts_tablet_manager.cc:1428] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:19:30.197088 21475 heartbeater.cc:503] Master 127.1.126.254:36675 was elected leader, sending a full tablet report...
I20260807 02:19:30.328612 21871 raft_consensus.cc:482] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:30.328953 21871 raft_consensus.cc:504] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.330293 21871 leader_election.cc:288] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd0007eecf844647999a4d5887394920 (127.1.126.195:41831), fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869)
I20260807 02:19:30.334443 21857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.330646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:54777 (local address 127.1.126.195:41831)
0807 02:19:30.330827 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.330832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.331066 (+ 234us) server_negotiation.cc:407] Connection header received
0807 02:19:30.331271 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.331280 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.331325 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.331405 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:30.331746 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.332256 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.333452 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.333847 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.333980 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.334035 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.334248 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.334312 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 02:19:30.334465 21873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.330510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:41831 (local address 127.1.126.193:54777)
0807 02:19:30.330962 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.330974 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.331144 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.331430 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.331432 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.331448 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:30.331624 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.331630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.332369 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.332375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.333318 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.333328 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.333989 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.333992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.334086 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.334130 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.334216 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.334286 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":114,"spinlock_wait_cycles":11136,"thread_start_us":144,"threads_started":1}
I20260807 02:19:30.334478 21859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.330753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:33209 (local address 127.1.126.194:42869)
0807 02:19:30.330897 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.330902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.331103 (+ 201us) server_negotiation.cc:407] Connection header received
0807 02:19:30.331283 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.331286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.331341 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.331431 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:30.331769 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.332274 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.333469 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.333862 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.333998 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.334051 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.334292 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.334354 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 02:19:30.334506 21872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.330615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42869 (local address 127.1.126.193:33209)
0807 02:19:30.330984 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.330995 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.331166 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.331441 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.331444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.331460 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:30.331649 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.331655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.332394 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.332397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.333335 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.333345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.333998 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.334002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.334166 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.334184 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.334274 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.334343 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":113,"spinlock_wait_cycles":3840,"thread_start_us":129,"threads_started":1}
I20260807 02:19:30.335259 21591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa61836d13b48ac8b0fef5655ca7411" candidate_uuid: "cba95a7085104eb988dda6fc2d029a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe460110f045475cbdacef3faa77a3cf" is_pre_election: true
I20260807 02:19:30.335264 21776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa61836d13b48ac8b0fef5655ca7411" candidate_uuid: "cba95a7085104eb988dda6fc2d029a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd0007eecf844647999a4d5887394920" is_pre_election: true
I20260807 02:19:30.335557 21591 raft_consensus.cc:2454] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cba95a7085104eb988dda6fc2d029a57 in term 0.
I20260807 02:19:30.335584 21776 raft_consensus.cc:2454] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cba95a7085104eb988dda6fc2d029a57 in term 0.
I20260807 02:19:30.336071 21319 leader_election.cc:302] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57, dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf; no voters:
I20260807 02:19:30.336354 21871 raft_consensus.cc:2781] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:19:30.336434 21871 raft_consensus.cc:482] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:19:30.336464 21871 raft_consensus.cc:3037] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:30.337544 21871 raft_consensus.cc:504] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.337929 21871 leader_election.cc:288] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 1 election: Requested vote from peers dd0007eecf844647999a4d5887394920 (127.1.126.195:41831), fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869)
I20260807 02:19:30.338225 21776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa61836d13b48ac8b0fef5655ca7411" candidate_uuid: "cba95a7085104eb988dda6fc2d029a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd0007eecf844647999a4d5887394920"
I20260807 02:19:30.338291 21591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa61836d13b48ac8b0fef5655ca7411" candidate_uuid: "cba95a7085104eb988dda6fc2d029a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe460110f045475cbdacef3faa77a3cf"
I20260807 02:19:30.338352 21776 raft_consensus.cc:3037] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:30.338423 21591 raft_consensus.cc:3037] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:30.339473 21776 raft_consensus.cc:2454] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cba95a7085104eb988dda6fc2d029a57 in term 1.
I20260807 02:19:30.339483 21591 raft_consensus.cc:2454] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cba95a7085104eb988dda6fc2d029a57 in term 1.
I20260807 02:19:30.339766 21319 leader_election.cc:302] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57, fe460110f045475cbdacef3faa77a3cf; no voters:
I20260807 02:19:30.339938 21871 raft_consensus.cc:2781] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:30.340165 21871 raft_consensus.cc:686] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 LEADER]: Becoming Leader. State: Replica: cba95a7085104eb988dda6fc2d029a57, State: Running, Role: LEADER
I20260807 02:19:30.340481 21871 consensus_queue.cc:237] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.343650 21205 catalog_manager.cc:5495] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 reported cstate change: term changed from 0 to 1, leader changed from <none> to cba95a7085104eb988dda6fc2d029a57 (127.1.126.193). New cstate: current_term: 1 leader_uuid: "cba95a7085104eb988dda6fc2d029a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } health_report { overall_health: UNKNOWN } } }
I20260807 02:19:30.359269 21855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.355888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.1.126.193:33785)
0807 02:19:30.356007 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.356010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.356023 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:19:30.356205 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.356207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.356258 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.356346 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:19:30.356548 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.357018 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.357865 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.358058 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.358134 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.358382 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:19:30.358831 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:19:30.358954 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.359063 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.359115 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:19:30.364678 21591 raft_consensus.cc:1261] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Refusing update from remote peer cba95a7085104eb988dda6fc2d029a57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:30.364686 21776 raft_consensus.cc:1261] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Refusing update from remote peer cba95a7085104eb988dda6fc2d029a57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:30.365437 21874 consensus_queue.cc:1035] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:30.365626 21871 consensus_queue.cc:1035] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:30.372138 21878 mvcc.cc:205] Tried to move back new op lower bound from 7315739321807138816 to 7315739321717301248. Current Snapshot: MvccSnapshot[applied={T|T < 7315739321807138816}]
W20260807 02:19:30.373584 21840 tablet.cc:2369] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:19:30.375762 21880 mvcc.cc:205] Tried to move back new op lower bound from 7315739321807138816 to 7315739321717301248. Current Snapshot: MvccSnapshot[applied={T|T < 7315739321807138816}]
I20260807 02:19:30.381299 21206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:30.381474 21206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:30.383751 21206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Sending DeleteTablet for 3 replicas of tablet 8aa61836d13b48ac8b0fef5655ca7411
I20260807 02:19:30.384549 21563 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:30 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:60336
I20260807 02:19:30.384545 21384 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:30 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37296
I20260807 02:19:30.384769 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21299
I20260807 02:19:30.385042 21751 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:30 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:35940
I20260807 02:19:30.388500 21887 tablet_replica.cc:330] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: stopping tablet replica
I20260807 02:19:30.388513 21893 tablet_replica.cc:330] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: stopping tablet replica
I20260807 02:19:30.388831 21893 raft_consensus.cc:2229] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:30.388831 21887 raft_consensus.cc:2229] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:30.389156 21887 raft_consensus.cc:2258] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:30.389155 21893 raft_consensus.cc:2258] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:30.390965 21887 ts_tablet_manager.cc:1905] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:30.394917 21887 ts_tablet_manager.cc:1918] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:30.395067 21887 log.cc:1196] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/8aa61836d13b48ac8b0fef5655ca7411
I20260807 02:19:30.395443 21887 ts_tablet_manager.cc:1939] T 8aa61836d13b48ac8b0fef5655ca7411 P fe460110f045475cbdacef3faa77a3cf: Deleting consensus metadata
I20260807 02:19:30.395988 21893 ts_tablet_manager.cc:1905] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:30.396934 21184 catalog_manager.cc:4841] TS fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): tablet 8aa61836d13b48ac8b0fef5655ca7411 (table test-table [id=cb97e6f104eb43e09df3906bc2a96fd7]) successfully deleted
I20260807 02:19:30.398499 21893 ts_tablet_manager.cc:1918] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:30.398592 21893 log.cc:1196] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/8aa61836d13b48ac8b0fef5655ca7411
I20260807 02:19:30.399006 21893 ts_tablet_manager.cc:1939] T 8aa61836d13b48ac8b0fef5655ca7411 P dd0007eecf844647999a4d5887394920: Deleting consensus metadata
W20260807 02:19:30.399468 21187 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:33785 (error 108)
I20260807 02:19:30.400542 21854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.400232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33785 (local address 127.0.0.1:37312)
0807 02:19:30.400369 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.400446 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 02:19:30.400714 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21482
I20260807 02:19:30.400700 21183 catalog_manager.cc:4841] TS dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): tablet 8aa61836d13b48ac8b0fef5655ca7411 (table test-table [id=cb97e6f104eb43e09df3906bc2a96fd7]) successfully deleted
W20260807 02:19:30.400820 21187 catalog_manager.cc:4584] TS cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8aa61836d13b48ac8b0fef5655ca7411: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33785: connect: Connection refused (error 111)
I20260807 02:19:30.417475 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21660
I20260807 02:19:30.426355 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21164
I20260807 02:19:30.435824 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36675
--webserver_interface=127.1.126.254
--webserver_port=44473
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:30.545112 21895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:30.545346 21895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:30.545382 21895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:30.549134 21895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:30.549180 21895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:30.549199 21895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:30.549216 21895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:30.549229 21895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:30.554152 21895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=44473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:30.555038 21895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:30.555919 21895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:30.569231 21901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.569234 21903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.569234 21905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:30.569341 21895 server_base.cc:1034] running on GCE node
I20260807 02:19:30.570189 21895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:30.571323 21895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:30.572485 21895 hybrid_clock.cc:648] HybridClock initialized: now 1786069170572465 us; error 32 us; skew 500 ppm
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:30.579264 21895 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:30.580206 21895 webserver.cc:460] Webserver started at http://127.1.126.254:44473/ using document root <none> and password file <none>
I20260807 02:19:30.580794 21895 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:30.580891 21895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:30.584632 21895 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 02:19:30.586654 21915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:30.587918 21895 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:30.588074 21895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "62c024bf11974bbb92fded67fda024c0"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "97b95b6f739515c19fe0adcf85e3f990"
server_key_iv: "f3929a723fa73d6501ca0f47e5559578"
server_key_version: "encryptionkey@0"
I20260807 02:19:30.588646 21895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:30.604894 21895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:30.608080 21895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:30.608289 21895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:30.615854 21895 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36675
I20260807 02:19:30.616147 21983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36675 every 8 connection(s)
I20260807 02:19:30.616945 21895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:30.621217 21986 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:19:30.622884 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap starting.
I20260807 02:19:30.622964 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21895
I20260807 02:19:30.623471 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:33785
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:36675
--webserver_port=46349
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:30.640946 21986 log.cc:824] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:30.650008 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:19:30.650404 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap complete.
I20260807 02:19:30.654544 21986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:30.654986 21986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62c024bf11974bbb92fded67fda024c0, State: Initialized, Role: FOLLOWER
I20260807 02:19:30.655471 21986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:30.655575 21986 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:30.655648 21986 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:30.655766 21986 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 02:19:30.657608 21986 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:30.657938 21986 leader_election.cc:302] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62c024bf11974bbb92fded67fda024c0; no voters:
I20260807 02:19:30.658265 21986 leader_election.cc:288] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 02:19:30.658404 21990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 02:19:30.658643 21990 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 LEADER]: Becoming Leader. State: Replica: 62c024bf11974bbb92fded67fda024c0, State: Running, Role: LEADER
I20260807 02:19:30.659022 21990 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:30.659469 21986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:30.660475 21991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "62c024bf11974bbb92fded67fda024c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } } }
I20260807 02:19:30.660596 21991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:30.660933 21992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62c024bf11974bbb92fded67fda024c0. Latest consensus state: current_term: 2 leader_uuid: "62c024bf11974bbb92fded67fda024c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } } }
I20260807 02:19:30.661089 21992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:30.661406 22002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:30.665946 22002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:30.666525 22002 catalog_manager.cc:1259] Loaded cluster ID: cc5bef97169842fe993cadf1a6cd6314
I20260807 02:19:30.666584 22002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:30.667941 22002 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 02:19:30.672896 22002 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 02:19:30.678031 22002 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:30.678748 22002 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Loaded TSK: 0
I20260807 02:19:30.679826 22002 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 02:19:30.737852 21988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:30.738106 21988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:30.738181 21988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:30.741935 21988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:30.742017 21988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:30.742146 21988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:19:30.747351 21988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:33785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=46349
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:30.748284 21988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:30.749233 21988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:30.758384 22022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.758426 22020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.758450 22019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:30.759006 21988 server_base.cc:1034] running on GCE node
I20260807 02:19:30.759503 21988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:30.760298 21988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:30.761513 21988 hybrid_clock.cc:648] HybridClock initialized: now 1786069170761494 us; error 44 us; skew 500 ppm
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:30.764981 21988 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:19:30.766662 21988 webserver.cc:460] Webserver started at http://127.1.126.193:46349/ using document root <none> and password file <none>
I20260807 02:19:30.767367 21988 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:30.767477 21988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:30.772435 21988 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:30.775255 22031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:30.776798 21988 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:30.776923 21988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "cba95a7085104eb988dda6fc2d029a57"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "ad18b2fcfa079e4f2a16ff11762b0d17"
server_key_iv: "8fbabe601861df2128636b6d47285322"
server_key_version: "encryptionkey@0"
I20260807 02:19:30.777590 21988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:30.790611 21988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:30.794075 21988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:30.794251 21988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:30.794934 21988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:30.796131 22040 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 02:19:30.800176 21988 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 02:19:30.800246 21988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260807 02:19:30.800304 21988 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 02:19:30.802404 21988 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 02:19:30.802456 21988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 02:19:30.802796 22040 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Bootstrap starting.
I20260807 02:19:30.812577 21988 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:33785
I20260807 02:19:30.812867 22180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:33785 every 8 connection(s)
I20260807 02:19:30.813634 21988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:19:30.820916 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 21988
I20260807 02:19:30.821384 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:42869
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:36675
--webserver_port=44035
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:30.822394 22040 log.cc:824] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Log is configured to *not* fsync() on all Append() calls
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:30.831624 22040 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:19:30.831845 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.815919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:42985)
0807 02:19:30.816738 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.816789 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.817964 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.819319 (+ 1355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.819328 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.819773 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:30.820520 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.820540 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.822326 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.822332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.823565 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.823576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.824284 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.824288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.824472 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.825142 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:30.825161 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:30.826779 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:30.828825 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:30.828831 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:30.828843 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:30.829091 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:30.829483 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:30.829487 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:30.829489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:30.829632 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:30.830185 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:30.830191 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:30.830446 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.830645 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.830985 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":144,"threads_started":1}
I20260807 02:19:30.831859 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.815905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:42985 (local address 127.1.126.254:36675)
0807 02:19:30.816441 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.816461 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.816916 (+ 455us) server_negotiation.cc:407] Connection header received
0807 02:19:30.818444 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.818460 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.818871 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.819229 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:30.820733 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.822158 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.823700 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.824140 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.824261 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.826987 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:30.826992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:30.827004 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:30.827029 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:30.828689 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.829247 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.829253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.829257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.829370 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.829732 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.829737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.829739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.830053 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:30.830200 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.830822 (+ 622us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.831070 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":116,"threads_started":1}
I20260807 02:19:30.832125 22040 tablet_bootstrap.cc:492] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Bootstrap complete.
I20260807 02:19:30.833577 22040 ts_tablet_manager.cc:1397] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.011s
I20260807 02:19:30.834609 22181 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36675
I20260807 02:19:30.834877 22181 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:30.835345 22181 heartbeater.cc:511] Master 127.1.126.254:36675 requested a full tablet report, sending...
I20260807 02:19:30.837545 21939 ts_manager.cc:194] Registered new tserver with Master: cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785)
I20260807 02:19:30.837201 22040 raft_consensus.cc:348] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.837664 22040 raft_consensus.cc:729] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cba95a7085104eb988dda6fc2d029a57, State: Initialized, Role: FOLLOWER
I20260807 02:19:30.838133 22040 consensus_queue.cc:260] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } }
I20260807 02:19:30.839128 22040 ts_tablet_manager.cc:1428] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
I20260807 02:19:30.841140 21939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:42985
I20260807 02:19:30.843513 22181 heartbeater.cc:503] Master 127.1.126.254:36675 was elected leader, sending a full tablet report...
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:19:30.851326 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.840511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33785 (local address 127.0.0.1:37322)
0807 02:19:30.841200 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:30.841243 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:30.841424 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:30.842081 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:30.842087 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:30.842485 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:30.842620 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.842628 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.843938 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.843943 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.844883 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:30.844895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.845669 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.845672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:30.845749 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.846293 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:30.846305 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:30.847696 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:30.849790 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:30.849797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:30.849802 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:30.850004 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:30.850298 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:30.850300 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:30.850301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:30.850372 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:30.850874 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:30.850879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:30.850970 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 02:19:30.851079 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 02:19:30.851210 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":103,"threads_started":1}
I20260807 02:19:30.851472 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:30.840602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.1.126.193:33785)
0807 02:19:30.840939 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:30.840949 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:30.841325 (+ 376us) server_negotiation.cc:407] Connection header received
0807 02:19:30.841574 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:30.841579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:30.841790 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:30.841899 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:30.842802 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.843812 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.845030 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:30.845549 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:30.845656 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:30.847827 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:30.847837 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:30.847851 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:30.847879 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:30.849649 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.850111 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.850117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.850118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.850208 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:30.850455 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:30.850458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:30.850459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:30.850758 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:30.850879 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:30.851178 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 02:19:30.851329 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":110,"threads_started":1}
I20260807 02:19:30.852360 22094 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aa61836d13b48ac8b0fef5655ca7411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:30 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37322
I20260807 02:19:30.853147 22194 tablet_replica.cc:330] stopping tablet replica
I20260807 02:19:30.853425 22194 raft_consensus.cc:2229] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:30.853658 22194 raft_consensus.cc:2258] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:30.854570 22194 ts_tablet_manager.cc:1905] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:30.857815 22194 ts_tablet_manager.cc:1918] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:30.857928 22194 log.cc:1196] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/8aa61836d13b48ac8b0fef5655ca7411
I20260807 02:19:30.858209 22194 ts_tablet_manager.cc:1939] T 8aa61836d13b48ac8b0fef5655ca7411 P cba95a7085104eb988dda6fc2d029a57: Deleting consensus metadata
I20260807 02:19:30.859869 21920 catalog_manager.cc:4841] TS cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785): tablet 8aa61836d13b48ac8b0fef5655ca7411 (table test-table [id=cb97e6f104eb43e09df3906bc2a96fd7]) successfully deleted
W20260807 02:19:30.940590 22190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:30.940806 22190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:30.940866 22190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:30.944957 22190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:30.945005 22190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:30.945115 22190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:19:30.950137 22190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:42869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=44035
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:30.951068 22190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:30.952029 22190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:30.961282 22203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.961287 22199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:30.961287 22200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:30.961404 22190 server_base.cc:1034] running on GCE node
I20260807 02:19:30.961947 22190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:30.962520 22190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:30.963702 22190 hybrid_clock.cc:648] HybridClock initialized: now 1786069170963686 us; error 31 us; skew 500 ppm
Aug 07 02:19:30 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:30.966465 22190 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:19:30.967294 22190 webserver.cc:460] Webserver started at http://127.1.126.194:44035/ using document root <none> and password file <none>
I20260807 02:19:30.967769 22190 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:30.967835 22190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:30.971258 22190 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:19:30.973142 22213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:30.974239 22190 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:30.974332 22190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "fe460110f045475cbdacef3faa77a3cf"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "a2d4f54ffd13661d8a0ad91f351198f3"
server_key_iv: "b184b98242c5e5c23bc85b3c7ff0fcd4"
server_key_version: "encryptionkey@0"
I20260807 02:19:30.974869 22190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:30.998138 22190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:31.001328 22190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:31.001480 22190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:31.002005 22190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:31.002833 22190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:31.002882 22190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.002923 22190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:31.002941 22190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.011368 22190 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42869
I20260807 02:19:31.011410 22368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42869 every 8 connection(s)
I20260807 02:19:31.012466 22190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
Aug 07 02:19:31 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069170, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:31.021342 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 22190
I20260807 02:19:31.021759 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:41831
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:36675
--webserver_port=37267
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:31.025491 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.014226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:46603 (local address 127.1.126.254:36675)
0807 02:19:31.014373 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.014377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.015580 (+ 1203us) server_negotiation.cc:407] Connection header received
0807 02:19:31.016356 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.016359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.016411 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.016484 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:31.017520 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.018049 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.019146 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.019359 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.019435 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.021738 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:31.021742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:31.021744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:31.021768 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:31.023266 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:31.023906 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:31.023910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:31.023911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:31.023991 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:31.024418 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:31.024421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:31.024422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:31.024586 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:31.024660 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.025264 (+ 604us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.025371 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:19:31.026600 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.014526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:46603)
0807 02:19:31.015433 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.015471 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.016178 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:31.016643 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:31.016649 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:31.016958 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:31.017398 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.017410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.018151 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.018154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.019006 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.019015 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.019483 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.019486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.019610 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.020105 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:31.020120 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:31.021559 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:31.023390 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:31.023396 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:31.023410 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:31.023797 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:31.024091 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:31.024096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:31.024099 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:31.024290 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:31.024691 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:31.024697 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:31.025009 (+ 312us) client_negotiation.cc:769] Sending connection context
0807 02:19:31.025228 (+ 219us) client_negotiation.cc:240] Negotiation successful
0807 02:19:31.025566 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":601,"threads_started":1}
I20260807 02:19:31.027881 22369 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36675
I20260807 02:19:31.028116 22369 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:31.028578 22369 heartbeater.cc:511] Master 127.1.126.254:36675 requested a full tablet report, sending...
I20260807 02:19:31.029633 21939 ts_manager.cc:194] Registered new tserver with Master: fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869)
I20260807 02:19:31.030185 21939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:46603
W20260807 02:19:31.135943 22373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:31.136210 22373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:31.136297 22373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:31.140090 22373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:31.140173 22373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:31.140259 22373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:19:31.145387 22373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:41831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=37267
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:31.146366 22373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:31.147372 22373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:31.156733 22383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:31.156888 22373 server_base.cc:1034] running on GCE node
W20260807 02:19:31.156746 22381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:31.156766 22379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:31.157421 22373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:31.158036 22373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:31.159188 22373 hybrid_clock.cc:648] HybridClock initialized: now 1786069171159155 us; error 45 us; skew 500 ppm
Aug 07 02:19:31 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:31.162072 22373 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:19:31.162905 22373 webserver.cc:460] Webserver started at http://127.1.126.195:37267/ using document root <none> and password file <none>
I20260807 02:19:31.163416 22373 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:31.163484 22373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:31.167130 22373 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 02:19:31.169023 22392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.170141 22373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:31.170233 22373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "dd0007eecf844647999a4d5887394920"
format_stamp: "Formatted at 2026-08-07 02:19:30 on dist-test-slave-39l8"
server_key: "16375f947b4d5e6d6d8bef672b542c56"
server_key_iv: "71463c7e502767ed2af15df09e1f156e"
server_key_version: "encryptionkey@0"
I20260807 02:19:31.170691 22373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:31.198556 22373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:31.201349 22373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:31.201494 22373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:31.201987 22373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:31.202795 22373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:31.202841 22373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.202879 22373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:31.202898 22373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.211799 22373 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:41831
I20260807 02:19:31.211833 22534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:41831 every 8 connection(s)
I20260807 02:19:31.212777 22373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:19:31.220829 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 22373
Aug 07 02:19:31 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:31.226307 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.214497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:44475 (local address 127.1.126.254:36675)
0807 02:19:31.214632 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.214635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.215493 (+ 858us) server_negotiation.cc:407] Connection header received
0807 02:19:31.216747 (+ 1254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.216750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.216809 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.216909 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:31.217996 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.218496 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.219585 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.219805 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.219909 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.222695 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:31.222734 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:31.222739 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:31.222766 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:31.224163 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:31.224747 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:31.224750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:31.224751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:31.224833 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:31.225173 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:31.225176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:31.225178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:31.225368 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:31.225482 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.226086 (+ 604us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.226184 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55,"spinlock_wait_cycles":3840}
I20260807 02:19:31.227488 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.214907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:44475)
0807 02:19:31.215352 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.215390 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.216538 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:31.217080 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:31.217086 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:31.217419 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:31.217852 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.217864 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.218615 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.218619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.219454 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.219463 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.219971 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.219975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.220150 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.220702 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:31.220717 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:31.222525 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:31.224279 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:31.224285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:31.224298 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:31.224628 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:31.224922 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:31.224925 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:31.224926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:31.225050 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:31.225494 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:31.225499 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:31.225804 (+ 305us) client_negotiation.cc:769] Sending connection context
0807 02:19:31.226046 (+ 242us) client_negotiation.cc:240] Negotiation successful
0807 02:19:31.226404 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":110,"threads_started":1}
I20260807 02:19:31.228611 22536 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36675
I20260807 02:19:31.228890 22536 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:31.229426 22536 heartbeater.cc:511] Master 127.1.126.254:36675 requested a full tablet report, sending...
I20260807 02:19:31.229892 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.221568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53122 (local address 127.1.126.254:36675)
0807 02:19:31.221798 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.221801 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.222041 (+ 240us) server_negotiation.cc:407] Connection header received
0807 02:19:31.222169 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.222172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.222212 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.222287 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:31.223203 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.223702 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.224746 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.225049 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.225150 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.226641 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:31.226645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:31.226648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:31.226673 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:31.228241 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:31.228667 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:31.228670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:31.228671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:31.228772 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:31.229073 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:31.229076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:31.229077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:31.229231 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:31.229380 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.229606 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.229717 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"spinlock_wait_cycles":1792,"thread_start_us":98,"threads_started":1}
I20260807 02:19:31.230625 21939 ts_manager.cc:194] Registered new tserver with Master: dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
I20260807 02:19:31.231267 21939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:44475
I20260807 02:19:31.231731 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:19:31.235708 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.232387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53132 (local address 127.1.126.254:36675)
0807 02:19:31.232515 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.232519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.232704 (+ 185us) server_negotiation.cc:407] Connection header received
0807 02:19:31.232834 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.232836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.232913 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.232990 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:19:31.233254 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.233705 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.234461 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.234671 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.234825 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.235054 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:19:31.235368 (+ 314us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:19:31.235453 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.235509 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.235553 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:19:31.236296 21937 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:53132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:19:31.239445 21937 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:19:31.246855 22094 tablet_service.cc:1467] Processing CreateTablet for tablet edf4179495aa43c8bef305740acaf626 (DEFAULT_TABLE table=test-table [id=dea9ee003a434c3680b8c33f83acbb0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:31.247560 22094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf4179495aa43c8bef305740acaf626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:31.250523 22040 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Bootstrap starting.
I20260807 02:19:31.251361 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.245797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42869 (local address 127.0.0.1:60348)
0807 02:19:31.245912 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.245933 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.245993 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:31.246972 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:31.246975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:31.246995 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:31.247087 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.247094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.248763 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.248767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.249909 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.249918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.250939 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.250942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.251036 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.251079 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 02:19:31.251171 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 02:19:31.251246 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 02:19:31.251451 22040 tablet_bootstrap.cc:654] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:31.251679 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.245988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60348 (local address 127.1.126.194:42869)
0807 02:19:31.246429 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.246443 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.246466 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:19:31.246544 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.246549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.246785 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.247382 (+ 597us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:31.247554 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.248619 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.250027 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.250775 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.250917 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.251056 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.251202 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.251292 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":110,"threads_started":1}
I20260807 02:19:31.252269 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.246209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:41831 (local address 127.0.0.1:35948)
0807 02:19:31.246979 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.246992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.247257 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:31.247905 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:31.247907 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:31.247921 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:31.247982 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.247985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.249025 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.249028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.250418 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.250429 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.251686 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.251689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.251789 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.251822 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 02:19:31.252062 (+ 240us) client_negotiation.cc:240] Negotiation successful
0807 02:19:31.252151 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":107,"threads_started":1}
I20260807 02:19:31.252689 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.246479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35948 (local address 127.1.126.195:41831)
0807 02:19:31.246797 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.246810 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.247166 (+ 356us) server_negotiation.cc:407] Connection header received
0807 02:19:31.247420 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.247425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.247595 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.247762 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:31.248110 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.248880 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.250566 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.251373 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.251482 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.251631 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.252416 (+ 785us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.252518 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":114,"threads_started":1}
I20260807 02:19:31.253119 22040 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: No bootstrap required, opened a new log
I20260807 02:19:31.253209 22040 ts_tablet_manager.cc:1397] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:19:31.253664 22040 raft_consensus.cc:348] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.253767 22040 raft_consensus.cc:374] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:31.253793 22040 raft_consensus.cc:729] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cba95a7085104eb988dda6fc2d029a57, State: Initialized, Role: FOLLOWER
I20260807 02:19:31.253926 22040 consensus_queue.cc:260] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.254202 22040 ts_tablet_manager.cc:1428] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 02:19:31.255187 22455 tablet_service.cc:1467] Processing CreateTablet for tablet edf4179495aa43c8bef305740acaf626 (DEFAULT_TABLE table=test-table [id=dea9ee003a434c3680b8c33f83acbb0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:31.255053 22278 tablet_service.cc:1467] Processing CreateTablet for tablet edf4179495aa43c8bef305740acaf626 (DEFAULT_TABLE table=test-table [id=dea9ee003a434c3680b8c33f83acbb0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:31.256096 22278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf4179495aa43c8bef305740acaf626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:31.256099 22455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edf4179495aa43c8bef305740acaf626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:31.264207 22552 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Bootstrap starting.
I20260807 02:19:31.264207 22551 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Bootstrap starting.
I20260807 02:19:31.266986 22552 tablet_bootstrap.cc:654] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:31.266992 22551 tablet_bootstrap.cc:654] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:31.267886 22552 log.cc:824] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:31.267886 22551 log.cc:824] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:31.269874 22551 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: No bootstrap required, opened a new log
I20260807 02:19:31.269990 22552 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: No bootstrap required, opened a new log
I20260807 02:19:31.270079 22551 ts_tablet_manager.cc:1397] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 02:19:31.270135 22552 ts_tablet_manager.cc:1397] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:19:31.274011 22551 raft_consensus.cc:348] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.274011 22552 raft_consensus.cc:348] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.274295 22552 raft_consensus.cc:374] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:31.274295 22551 raft_consensus.cc:374] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:31.274371 22551 raft_consensus.cc:729] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe460110f045475cbdacef3faa77a3cf, State: Initialized, Role: FOLLOWER
I20260807 02:19:31.274379 22552 raft_consensus.cc:729] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0007eecf844647999a4d5887394920, State: Initialized, Role: FOLLOWER
I20260807 02:19:31.274866 22551 consensus_queue.cc:260] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.274902 22552 consensus_queue.cc:260] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.275511 22536 heartbeater.cc:503] Master 127.1.126.254:36675 was elected leader, sending a full tablet report...
I20260807 02:19:31.275816 22552 ts_tablet_manager.cc:1428] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:19:31.276480 22369 heartbeater.cc:503] Master 127.1.126.254:36675 was elected leader, sending a full tablet report...
I20260807 02:19:31.277832 22551 ts_tablet_manager.cc:1428] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260807 02:19:31.314913 22182 tablet.cc:2369] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:19:31.423645 22557 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:31.423991 22557 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.425192 22557 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785)
I20260807 02:19:31.428596 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.425460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42869 (local address 127.1.126.195:55381)
0807 02:19:31.425562 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.425578 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.425670 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:31.425943 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:31.425946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:31.425962 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:31.426084 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.426090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.426811 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.426815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.427530 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.427538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.428170 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.428173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.428279 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.428307 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 02:19:31.428396 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 02:19:31.428467 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 02:19:31.428596 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.425579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:55381 (local address 127.1.126.194:42869)
0807 02:19:31.425701 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.425708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.425727 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:19:31.425787 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.425789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.425838 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.425921 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:31.426205 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.426661 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.427661 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.428046 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.428186 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.428244 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.428413 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.428481 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:19:31.429082 22559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.425460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33785 (local address 127.1.126.195:35073)
0807 02:19:31.425955 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.425967 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.426091 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:31.426392 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:31.426394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:31.426409 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:31.426521 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.426526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.427256 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.427261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.428010 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:31.428018 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.428713 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.428716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:31.428800 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.428820 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:19:31.428884 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 02:19:31.428944 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":137,"thread_start_us":130,"threads_started":1}
I20260807 02:19:31.429073 22560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.425681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:35073 (local address 127.1.126.193:33785)
0807 02:19:31.425957 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.425963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.426054 (+ 91us) server_negotiation.cc:407] Connection header received
0807 02:19:31.426210 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.426212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.426273 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.426380 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:31.426637 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.427145 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.428139 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.428563 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.428712 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.428860 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.428900 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.428963 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":100,"threads_started":1}
I20260807 02:19:31.429268 22307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf4179495aa43c8bef305740acaf626" candidate_uuid: "dd0007eecf844647999a4d5887394920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe460110f045475cbdacef3faa77a3cf" is_pre_election: true
I20260807 02:19:31.429589 22307 raft_consensus.cc:2454] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd0007eecf844647999a4d5887394920 in term 0.
I20260807 02:19:31.429750 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf4179495aa43c8bef305740acaf626" candidate_uuid: "dd0007eecf844647999a4d5887394920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cba95a7085104eb988dda6fc2d029a57" is_pre_election: true
I20260807 02:19:31.430029 22118 raft_consensus.cc:2454] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd0007eecf844647999a4d5887394920 in term 0.
I20260807 02:19:31.430105 22394 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf; no voters:
I20260807 02:19:31.430447 22557 raft_consensus.cc:2781] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:19:31.430536 22557 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:19:31.430576 22557 raft_consensus.cc:3037] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:31.431618 22557 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.431955 22557 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [CANDIDATE]: Term 1 election: Requested vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785)
I20260807 02:19:31.432322 22118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf4179495aa43c8bef305740acaf626" candidate_uuid: "dd0007eecf844647999a4d5887394920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cba95a7085104eb988dda6fc2d029a57"
I20260807 02:19:31.432358 22307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edf4179495aa43c8bef305740acaf626" candidate_uuid: "dd0007eecf844647999a4d5887394920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe460110f045475cbdacef3faa77a3cf"
I20260807 02:19:31.432453 22118 raft_consensus.cc:3037] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:31.432453 22307 raft_consensus.cc:3037] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:31.433652 22118 raft_consensus.cc:2454] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd0007eecf844647999a4d5887394920 in term 1.
I20260807 02:19:31.433652 22307 raft_consensus.cc:2454] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd0007eecf844647999a4d5887394920 in term 1.
I20260807 02:19:31.433918 22394 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf; no voters:
I20260807 02:19:31.434094 22557 raft_consensus.cc:2781] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:31.434301 22557 raft_consensus.cc:686] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 1 LEADER]: Becoming Leader. State: Replica: dd0007eecf844647999a4d5887394920, State: Running, Role: LEADER
I20260807 02:19:31.434638 22557 consensus_queue.cc:237] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.437704 21937 catalog_manager.cc:5495] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd0007eecf844647999a4d5887394920 (127.1.126.195). New cstate: current_term: 1 leader_uuid: "dd0007eecf844647999a4d5887394920" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } health_report { overall_health: UNKNOWN } } }
W20260807 02:19:31.463672 22537 tablet.cc:2369] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:19:31.491998 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.488859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42080 (local address 127.1.126.195:41831)
0807 02:19:31.488995 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:31.488998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:31.489012 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:19:31.489164 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:31.489166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:31.489219 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:31.489304 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:19:31.489499 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.489995 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.490776 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:31.490970 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:31.491042 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:31.491289 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:19:31.491658 (+ 369us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:19:31.491744 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:31.491840 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 02:19:31.491898 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:19:31.497803 22307 raft_consensus.cc:1261] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Refusing update from remote peer dd0007eecf844647999a4d5887394920: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:31.497802 22118 raft_consensus.cc:1261] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Refusing update from remote peer dd0007eecf844647999a4d5887394920: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:31.498636 22557 consensus_queue.cc:1035] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:31.498864 22561 consensus_queue.cc:1035] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:31.505002 22564 mvcc.cc:205] Tried to move back new op lower bound from 7315739326447337472 to 7315739326198886400. Current Snapshot: MvccSnapshot[applied={T|T < 7315739326447337472}]
I20260807 02:19:31.506052 22566 mvcc.cc:205] Tried to move back new op lower bound from 7315739326447337472 to 7315739326198886400. Current Snapshot: MvccSnapshot[applied={T|T < 7315739326447337472}]
I20260807 02:19:31.513096 21939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:53132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:31.513269 21939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:53132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:31.515686 21939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Sending DeleteTablet for 3 replicas of tablet edf4179495aa43c8bef305740acaf626
I20260807 02:19:31.516348 22278 tablet_service.cc:1514] Processing DeleteTablet for tablet edf4179495aa43c8bef305740acaf626 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:31 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:60348
I20260807 02:19:31.516541 22094 tablet_service.cc:1514] Processing DeleteTablet for tablet edf4179495aa43c8bef305740acaf626 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:31 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:37322
I20260807 02:19:31.516935 22579 tablet_replica.cc:330] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: stopping tablet replica
I20260807 02:19:31.516891 22455 tablet_service.cc:1514] Processing DeleteTablet for tablet edf4179495aa43c8bef305740acaf626 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:31 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:35948
I20260807 02:19:31.517055 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21988
I20260807 02:19:31.517198 22579 raft_consensus.cc:2229] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:31.517390 22579 raft_consensus.cc:2258] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:31.522922 22578 tablet_replica.cc:330] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: stopping tablet replica
I20260807 02:19:31.523379 22578 raft_consensus.cc:2229] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:31.523689 22578 raft_consensus.cc:2258] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:31.525564 22580 tablet_replica.cc:330] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: stopping tablet replica
I20260807 02:19:31.525840 22580 raft_consensus.cc:2229] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:19:31.525892 22578 ts_tablet_manager.cc:1905] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:31.526185 22580 raft_consensus.cc:2258] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:31.527745 22580 ts_tablet_manager.cc:1905] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:31.529697 22578 ts_tablet_manager.cc:1918] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:31.529850 22578 log.cc:1196] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/edf4179495aa43c8bef305740acaf626
I20260807 02:19:31.530269 22578 ts_tablet_manager.cc:1939] T edf4179495aa43c8bef305740acaf626 P fe460110f045475cbdacef3faa77a3cf: Deleting consensus metadata
I20260807 02:19:31.530326 22580 ts_tablet_manager.cc:1918] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:31.530419 22580 log.cc:1196] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/edf4179495aa43c8bef305740acaf626
I20260807 02:19:31.530789 22580 ts_tablet_manager.cc:1939] T edf4179495aa43c8bef305740acaf626 P dd0007eecf844647999a4d5887394920: Deleting consensus metadata
I20260807 02:19:31.531747 21917 catalog_manager.cc:4841] TS fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): tablet edf4179495aa43c8bef305740acaf626 (table test-table [id=dea9ee003a434c3680b8c33f83acbb0f]) successfully deleted
I20260807 02:19:31.531783 21916 catalog_manager.cc:4841] TS dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): tablet edf4179495aa43c8bef305740acaf626 (table test-table [id=dea9ee003a434c3680b8c33f83acbb0f]) successfully deleted
W20260807 02:19:31.534212 21920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:33785 (error 108)
I20260807 02:19:31.534507 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 22190
I20260807 02:19:31.542294 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:31.541929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:33785 (local address 127.0.0.1:50104)
0807 02:19:31.542127 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.542199 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260807 02:19:31.542536 21920 catalog_manager.cc:4584] TS cba95a7085104eb988dda6fc2d029a57 (127.1.126.193:33785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet edf4179495aa43c8bef305740acaf626: Network error: Client connection negotiation failed: client connection to 127.1.126.193:33785: connect: Connection refused (error 111)
I20260807 02:19:31.549803 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 22373
I20260807 02:19:31.561321 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 21895
I20260807 02:19:31.572752 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36675
--webserver_interface=127.1.126.254
--webserver_port=44473
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:31.681885 22582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:31.682152 22582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:31.682226 22582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:31.686060 22582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:31.686144 22582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:31.686180 22582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:31.686219 22582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:31.686254 22582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:31.691363 22582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=44473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:31.692358 22582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:31.693329 22582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:31.701741 22593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:31.701707 22594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:31.702014 22582 server_base.cc:1034] running on GCE node
W20260807 02:19:31.701728 22598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:31.702548 22582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:31.703567 22582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:31.704733 22582 hybrid_clock.cc:648] HybridClock initialized: now 1786069171704714 us; error 29 us; skew 500 ppm
Aug 07 02:19:31 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:31.707363 22582 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:31.708179 22582 webserver.cc:460] Webserver started at http://127.1.126.254:44473/ using document root <none> and password file <none>
I20260807 02:19:31.708747 22582 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:31.708840 22582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:31.712507 22582 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:19:31.714545 22606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.715734 22582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:19:31.715883 22582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "62c024bf11974bbb92fded67fda024c0"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "97b95b6f739515c19fe0adcf85e3f990"
server_key_iv: "f3929a723fa73d6501ca0f47e5559578"
server_key_version: "encryptionkey@0"
I20260807 02:19:31.716399 22582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:31.735251 22582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:31.737874 22582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:31.738073 22582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:31.744997 22582 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36675
I20260807 02:19:31.745280 22669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36675 every 8 connection(s)
I20260807 02:19:31.746090 22582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:31.749691 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 22582
I20260807 02:19:31.750104 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:33785
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:36675
--webserver_port=46349
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:31.750473 22670 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:19:31.752282 22670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap starting.
I20260807 02:19:31.769589 22670 log.cc:824] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:31.780547 22670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:19:31.780907 22670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0: Bootstrap complete.
I20260807 02:19:31.784844 22670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:31.785199 22670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62c024bf11974bbb92fded67fda024c0, State: Initialized, Role: FOLLOWER
I20260807 02:19:31.785722 22670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:31.785872 22670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:31.785943 22670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:31.786065 22670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 02:19:31.787866 22670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:31.788194 22670 leader_election.cc:302] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62c024bf11974bbb92fded67fda024c0; no voters:
I20260807 02:19:31.788547 22670 leader_election.cc:288] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 02:19:31.788604 22674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 02:19:31.788811 22674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [term 3 LEADER]: Becoming Leader. State: Replica: 62c024bf11974bbb92fded67fda024c0, State: Running, Role: LEADER
I20260807 02:19:31.789088 22674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } }
I20260807 02:19:31.789746 22670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:31.790002 22677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "62c024bf11974bbb92fded67fda024c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } } }
I20260807 02:19:31.790139 22677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:31.790470 22675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62c024bf11974bbb92fded67fda024c0. Latest consensus state: current_term: 3 leader_uuid: "62c024bf11974bbb92fded67fda024c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c024bf11974bbb92fded67fda024c0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36675 } } }
I20260807 02:19:31.790582 22675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c024bf11974bbb92fded67fda024c0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:31.791054 22679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:31.796255 22679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:31.796927 22679 catalog_manager.cc:1259] Loaded cluster ID: cc5bef97169842fe993cadf1a6cd6314
I20260807 02:19:31.796988 22679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 02:19:31.798060 22679 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fcd3c7469ad google::LogMessage::Fail() at ??:0
@ 0x7fcd3c74988a google::LogMessage::SendToLog() at ??:0
@ 0x7fcd3c7464de google::LogMessage::Flush() at ??:0
@ 0x7fcd3c747a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fcd47085fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fcd47086d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fcd47083579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fcd470c7640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fcd3e9983d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fcd3e998c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fcd3e99a3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fcd3e989512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcd3ffcd6db start_thread at ??:0
@ 0x7fcd3b24461f clone at ??:0
W20260807 02:19:31.894892 22672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:31.895278 22672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:31.895344 22672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:31.901293 22672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:31.901363 22672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:31.901460 22672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:19:31.908735 22672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:33785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=46349
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:31.910130 22672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:31.911486 22672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:31.922441 22724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:31.922492 22728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:31.922441 22731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:31.922889 22672 server_base.cc:1034] running on GCE node
I20260807 02:19:31.923359 22672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:31.924141 22672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:31.925354 22672 hybrid_clock.cc:648] HybridClock initialized: now 1786069171925313 us; error 46 us; skew 500 ppm
Aug 07 02:19:31 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:31.928558 22672 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:19:31.929350 22672 webserver.cc:460] Webserver started at http://127.1.126.193:46349/ using document root <none> and password file <none>
I20260807 02:19:31.929888 22672 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:31.929991 22672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:31.934034 22672 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:19:31.936321 22741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:31.937626 22672 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:19:31.937788 22672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "cba95a7085104eb988dda6fc2d029a57"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "ad18b2fcfa079e4f2a16ff11762b0d17"
server_key_iv: "8fbabe601861df2128636b6d47285322"
server_key_version: "encryptionkey@0"
I20260807 02:19:31.938308 22672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:31.950578 22672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:31.953744 22672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:31.953945 22672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:31.954524 22672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:31.955664 22749 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 02:19:31.959625 22672 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 02:19:31.959688 22672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260807 02:19:31.959733 22672 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 02:19:31.961344 22672 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 02:19:31.961400 22672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 02:19:31.961656 22749 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Bootstrap starting.
I20260807 02:19:31.972235 22672 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:33785
I20260807 02:19:31.972491 22894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:33785 every 8 connection(s)
I20260807 02:19:31.973420 22672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:19:31.978544 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 22672
I20260807 02:19:31.979187 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:42869
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:36675
--webserver_port=44035
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:31.982115 22749 log.cc:824] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:31.991787 22749 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:19:31.992291 22749 tablet_bootstrap.cc:492] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Bootstrap complete.
I20260807 02:19:31.993801 22749 ts_tablet_manager.cc:1397] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Time spent bootstrapping tablet: real 0.032s user 0.020s sys 0.008s
I20260807 02:19:31.996832 22749 raft_consensus.cc:348] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.997339 22749 raft_consensus.cc:729] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cba95a7085104eb988dda6fc2d029a57, State: Initialized, Role: FOLLOWER
I20260807 02:19:31.997833 22749 consensus_queue.cc:260] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:31.998803 22749 ts_tablet_manager.cc:1428] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260807 02:19:32.032462 22898 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:19:31.975731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:40831)
0807 02:19:31.976340 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:31.976397 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:31.977609 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:32.031694 (+ 54085us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":159,"threads_started":1}
W20260807 02:19:32.033067 22895 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36675 (0 consecutive failures): Network error: Failed to ping master at 127.1.126.254:36675: Client connection negotiation failed: client connection to 127.1.126.254:36675: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 02:19:32.033823 22898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.033573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:60797)
0807 02:19:32.033706 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.033766 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 02:19:32.034621 22898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.034400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:57379)
0807 02:19:32.034529 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.034571 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 02:19:32.034910 22895 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:19:32.106889 22900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:32.107106 22900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:32.107146 22900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:32.111155 22900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:32.111207 22900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:32.111292 22900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:19:32.116281 22900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:42869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=44035
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:32.117199 22900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:32.118119 22900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:32.127249 22908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:32.127254 22909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:32.127221 22911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:32.127442 22900 server_base.cc:1034] running on GCE node
I20260807 02:19:32.127909 22900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:32.128497 22900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:32.129734 22900 hybrid_clock.cc:648] HybridClock initialized: now 1786069172129712 us; error 28 us; skew 500 ppm
Aug 07 02:19:32 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069172, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:32.132508 22900 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:19:32.133476 22900 webserver.cc:460] Webserver started at http://127.1.126.194:44035/ using document root <none> and password file <none>
I20260807 02:19:32.134019 22900 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:32.134111 22900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:32.137712 22900 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:32.139726 22923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:32.140983 22900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:32.141126 22900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "fe460110f045475cbdacef3faa77a3cf"
format_stamp: "Formatted at 2026-08-07 02:19:29 on dist-test-slave-39l8"
server_key: "a2d4f54ffd13661d8a0ad91f351198f3"
server_key_iv: "b184b98242c5e5c23bc85b3c7ff0fcd4"
server_key_version: "encryptionkey@0"
I20260807 02:19:32.141635 22900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:32.153442 22900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:32.156036 22900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:32.156219 22900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:32.156754 22900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:32.157581 22900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:32.157660 22900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:32.157732 22900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:32.157785 22900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:32.166749 22900 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42869
I20260807 02:19:32.166818 23064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42869 every 8 connection(s)
I20260807 02:19:32.167742 22900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:19:32.170523 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 22900
I20260807 02:19:32.171060 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:41831
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:36675
--webserver_port=37267
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:19:32.171710 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.169754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:36569)
0807 02:19:32.170182 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.170803 (+ 621us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":101,"threads_started":1}
W20260807 02:19:32.172183 23066 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36675 (0 consecutive failures): Network error: Failed to ping master at 127.1.126.254:36675: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
I20260807 02:19:32.172832 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.172549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:48751)
0807 02:19:32.172687 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.172753 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 02:19:32.173527 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.173308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:48177)
0807 02:19:32.173430 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.173482 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 02:19:32.173703 23066 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:19:32.280383 23071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:32.280644 23071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:32.280718 23071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:32.284636 23071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:32.284714 23071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:32.284801 23071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:19:32.289778 23071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:41831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=37267
--tserver_master_addrs=127.1.126.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:32.290865 23071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:32.291836 23071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:32.301395 23076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:32.301394 23077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:32.301452 23071 server_base.cc:1034] running on GCE node
W20260807 02:19:32.301414 23080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:32.302064 23071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:32.302659 23071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:32.303889 23071 hybrid_clock.cc:648] HybridClock initialized: now 1786069172303866 us; error 42 us; skew 500 ppm
Aug 07 02:19:32 dist-test-slave-39l8 krb5kdc[21148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069172, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:32.306581 23071 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:19:32.307446 23071 webserver.cc:460] Webserver started at http://127.1.126.195:37267/ using document root <none> and password file <none>
I20260807 02:19:32.308005 23071 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:32.308068 23071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:32.311573 23071 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 02:19:32.313470 23089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:32.314616 23071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 02:19:32.314777 23071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "dd0007eecf844647999a4d5887394920"
format_stamp: "Formatted at 2026-08-07 02:19:30 on dist-test-slave-39l8"
server_key: "16375f947b4d5e6d6d8bef672b542c56"
server_key_iv: "71463c7e502767ed2af15df09e1f156e"
server_key_version: "encryptionkey@0"
I20260807 02:19:32.315271 23071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:32.332293 23071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:32.335784 23071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:32.335942 23071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:32.336488 23071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:32.337276 23071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:32.337324 23071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:32.337365 23071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:32.337386 23071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:32.346879 23071 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:41831
I20260807 02:19:32.346957 23243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:41831 every 8 connection(s)
I20260807 02:19:32.347911 23071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:19:32.348418 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 23071
I20260807 02:19:32.351869 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.350258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:47973)
0807 02:19:32.350746 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.351192 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
W20260807 02:19:32.352313 23244 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:36675 (0 consecutive failures): Network error: Failed to ping master at 127.1.126.254:36675: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
I20260807 02:19:32.352895 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.352677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:40093)
0807 02:19:32.352792 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.352844 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 02:19:32.353458 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:32.353258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:58067)
0807 02:19:32.353360 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:32.353405 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 02:19:32.353637 23244 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 02:19:33.035908 23250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.035452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:57155)
0807 02:19:33.035721 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:33.035780 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":73,"threads_started":1}
I20260807 02:19:33.174562 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.174182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:54713)
0807 02:19:33.174416 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:33.174467 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":70,"threads_started":1}
I20260807 02:19:33.354498 23253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.354106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:40171)
0807 02:19:33.354349 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:33.354398 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":67,"threads_started":1}
I20260807 02:19:33.711335 23255 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:33.711530 23255 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:33.712642 23255 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
Aug 07 02:19:33 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.194@KRBTEST.COM
Aug 07 02:19:33 dist-test-slave-39l8 krb5kdc[21148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.195@KRBTEST.COM
I20260807 02:19:33.726755 23256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.712882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:41831 (local address 127.1.126.193:33999)
0807 02:19:33.713238 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:33.713254 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:33.713355 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:33.715148 (+ 1793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:33.715154 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:33.715678 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:33.716137 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:33.716151 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.717355 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.717359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:33.718317 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:33.718328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.719096 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.719103 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:33.719306 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:33.720077 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:33.720089 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:33.721808 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:33.724362 (+ 2554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:33.724363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:33.724365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:33.724515 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:33.724932 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:33.724937 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:33.724942 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:33.725159 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:33.725888 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:33.725891 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:33.725959 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 02:19:33.726115 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 02:19:33.726552 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":278,"spinlock_wait_cycles":3456,"thread_start_us":74,"threads_started":1}
I20260807 02:19:33.726763 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.713018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:42937 (local address 127.1.126.194:42869)
0807 02:19:33.713517 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:33.713533 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:33.713576 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:19:33.714397 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:33.714404 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:33.714799 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:33.715089 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:33.716306 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.717385 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.718442 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.719012 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.719196 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:33.721732 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:33.721736 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:33.721747 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:33.721773 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:33.723899 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:33.724420 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:33.724427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:33.724433 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:33.724601 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:33.725022 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:33.725025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:33.725027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:33.725560 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:33.725686 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:33.726270 (+ 584us) server_negotiation.cc:299] Negotiation successful
0807 02:19:33.726543 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":129,"threads_started":1}
I20260807 02:19:33.726766 23259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.713113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:33999 (local address 127.1.126.195:41831)
0807 02:19:33.713526 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:33.713545 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:33.713577 (+ 32us) server_negotiation.cc:407] Connection header received
0807 02:19:33.714399 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:33.714406 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:33.714803 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:33.715090 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:33.716306 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.717223 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.718478 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.718976 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.719132 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:33.721992 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:33.721999 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:33.722014 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:33.722048 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:33.723899 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:33.724638 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:33.724647 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:33.724654 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:33.724812 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:33.725267 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:33.725271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:33.725273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:33.725779 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:33.725865 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:33.726270 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 02:19:33.726543 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":84,"threads_started":1}
I20260807 02:19:33.727059 23257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:33.712832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42869 (local address 127.1.126.193:42937)
0807 02:19:33.713136 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:33.713151 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:33.713286 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:33.715148 (+ 1862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:33.715154 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:33.715675 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:33.716137 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:33.716150 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.717507 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.717510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:33.718319 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:33.718329 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:33.719154 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:33.719159 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:33.719372 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:33.720017 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:33.720033 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:33.721499 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:33.724013 (+ 2514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:33.724017 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:33.724028 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:33.724268 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:33.724725 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:33.724728 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:33.724730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:33.724913 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:33.725692 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:33.725697 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:33.725921 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 02:19:33.726115 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 02:19:33.726498 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":196,"spinlock_wait_cycles":22912,"thread_start_us":75,"threads_started":1}
W20260807 02:19:33.729475 22742 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
W20260807 02:19:33.729638 22743 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
I20260807 02:19:33.729719 22743 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57; no voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf
I20260807 02:19:33.729947 23255 raft_consensus.cc:2726] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:19:34.037257 23257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:34.036906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:58973)
0807 02:19:34.037068 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:34.037146 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 02:19:34.175724 23260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:34.175307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:51737)
0807 02:19:34.175552 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:34.175610 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":73,"threads_started":1}
I20260807 02:19:34.355579 23261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:34.355236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:36751)
0807 02:19:34.355454 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:34.355502 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":64,"threads_started":1}
I20260807 02:19:35.038450 23263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:35.038054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:54755)
0807 02:19:35.038307 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:35.038357 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":96,"threads_started":1}
I20260807 02:19:35.176774 23264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:35.176414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:36367)
0807 02:19:35.176634 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:35.176686 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260807 02:19:35.356704 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:35.356276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:53571)
0807 02:19:35.356523 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:35.356575 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
I20260807 02:19:35.380929 23267 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:35.381107 23267 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:35.381537 23267 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
W20260807 02:19:35.382422 22743 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
W20260807 02:19:35.382527 22742 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
I20260807 02:19:35.382643 22742 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57; no voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf
I20260807 02:19:35.382860 23267 raft_consensus.cc:2726] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:19:36.039675 23270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:36.039254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:47837)
0807 02:19:36.039520 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:36.039577 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":82,"threads_started":1}
I20260807 02:19:36.177987 23271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:36.177544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:59783)
0807 02:19:36.177847 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:36.177900 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":122,"threads_started":1}
I20260807 02:19:36.358068 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:36.357572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:42727)
0807 02:19:36.357913 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:36.357976 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":102,"threads_started":1}
I20260807 02:19:37.041249 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:37.040595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:57571)
0807 02:19:37.041076 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:37.041149 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":72,"threads_started":1}
I20260807 02:19:37.179337 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:37.178927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:34757)
0807 02:19:37.179197 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:37.179250 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":88,"threads_started":1}
I20260807 02:19:37.359196 23277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:37.358793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:54621)
0807 02:19:37.359050 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:37.359101 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":92,"threads_started":1}
I20260807 02:19:38.045159 23278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:38.043678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:39461)
0807 02:19:38.044910 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:38.044993 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1115,"thread_start_us":1007,"threads_started":1}
I20260807 02:19:38.180452 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:38.180039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:47067)
0807 02:19:38.180295 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:38.180349 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":84,"threads_started":1}
I20260807 02:19:38.360255 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:38.359897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:43543)
0807 02:19:38.360121 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:38.360173 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
I20260807 02:19:38.685432 23281 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:38.685637 23281 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:38.686110 23281 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
W20260807 02:19:38.686975 22743 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
W20260807 02:19:38.687088 22742 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
I20260807 02:19:38.687211 22742 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57; no voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf
I20260807 02:19:38.687369 23281 raft_consensus.cc:2726] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:19:39.046562 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:39.046023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:60701)
0807 02:19:39.046378 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:39.046437 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":83,"threads_started":1}
I20260807 02:19:39.181505 23284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:39.181108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:52413)
0807 02:19:39.181373 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:39.181422 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":65,"threads_started":1}
I20260807 02:19:39.361378 23285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:39.360958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:52429)
0807 02:19:39.361242 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:39.361294 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":66,"threads_started":1}
I20260807 02:19:40.047770 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:40.047356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:49389)
0807 02:19:40.047608 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:40.047665 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":79,"threads_started":1}
I20260807 02:19:40.182578 23287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:40.182213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:42661)
0807 02:19:40.182443 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:40.182494 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
I20260807 02:19:40.362511 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:40.362118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:41123)
0807 02:19:40.362376 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:40.362426 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":90,"threads_started":1}
I20260807 02:19:41.048976 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:41.048526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:60337)
0807 02:19:41.048814 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:41.048877 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":87,"threads_started":1}
I20260807 02:19:41.183697 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:41.183311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:54601)
0807 02:19:41.183555 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:41.183607 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":75,"threads_started":1}
I20260807 02:19:41.363665 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:41.363264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:44275)
0807 02:19:41.363521 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:41.363574 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":94,"threads_started":1}
I20260807 02:19:42.050283 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:42.049891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:54407)
0807 02:19:42.050135 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:42.050187 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":79,"threads_started":1}
I20260807 02:19:42.184854 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:42.184452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:56205)
0807 02:19:42.184702 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:42.184757 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":73,"threads_started":1}
I20260807 02:19:42.364913 23299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:42.364486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:40761)
0807 02:19:42.364760 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:42.364816 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":96,"threads_started":1}
I20260807 02:19:42.965161 23300 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:42.965302 23300 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:42.965787 23300 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
W20260807 02:19:42.966576 22742 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
W20260807 02:19:42.966677 22743 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
I20260807 02:19:42.966812 22743 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57; no voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf
I20260807 02:19:42.967005 23300 raft_consensus.cc:2726] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:19:43.051494 23302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:43.051056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:41177)
0807 02:19:43.051345 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:43.051397 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":94,"threads_started":1}
I20260807 02:19:43.186184 23303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:43.185732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:38839)
0807 02:19:43.186009 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:43.186067 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":92,"threads_started":1}
I20260807 02:19:43.366165 23305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:43.365687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:54045)
0807 02:19:43.365979 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:43.366072 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":128,"threads_started":1}
I20260807 02:19:44.052671 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:44.052243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:54489)
0807 02:19:44.052513 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:44.052572 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":71,"threads_started":1}
I20260807 02:19:44.187361 23308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:44.186957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:46267)
0807 02:19:44.187220 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:44.187270 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
I20260807 02:19:44.367259 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:44.366872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:53159)
0807 02:19:44.367100 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:44.367157 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":72,"threads_started":1}
I20260807 02:19:45.053746 23310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:45.053361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:49841)
0807 02:19:45.053595 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:45.053646 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":75,"threads_started":1}
I20260807 02:19:45.188530 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:45.188082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:52543)
0807 02:19:45.188372 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:45.188433 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":76,"threads_started":1}
I20260807 02:19:45.368322 23315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:45.367948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:48913)
0807 02:19:45.368175 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:45.368231 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":72,"threads_started":1}
I20260807 02:19:46.054920 23316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:46.054455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:48397)
0807 02:19:46.054772 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:46.054825 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":105,"threads_started":1}
I20260807 02:19:46.189774 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:46.189384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:37987)
0807 02:19:46.189630 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:46.189680 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":92,"threads_started":1}
I20260807 02:19:46.369410 23318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:46.369024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:56341)
0807 02:19:46.369264 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:46.369319 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":86,"threads_started":1}
I20260807 02:19:46.468695 23319 raft_consensus.cc:482] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:46.468825 23319 raft_consensus.cc:504] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe460110f045475cbdacef3faa77a3cf" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42869 } } peers { permanent_uuid: "dd0007eecf844647999a4d5887394920" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41831 } } peers { permanent_uuid: "cba95a7085104eb988dda6fc2d029a57" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 33785 } }
I20260807 02:19:46.469242 23319 leader_election.cc:288] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869), dd0007eecf844647999a4d5887394920 (127.1.126.195:41831)
W20260807 02:19:46.469983 22742 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd0007eecf844647999a4d5887394920 (127.1.126.195:41831): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
W20260807 02:19:46.470180 22743 leader_election.cc:341] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe460110f045475cbdacef3faa77a3cf (127.1.126.194:42869): Not found: Tablet not found: edf4179495aa43c8bef305740acaf626
I20260807 02:19:46.470288 22743 leader_election.cc:302] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cba95a7085104eb988dda6fc2d029a57; no voters: dd0007eecf844647999a4d5887394920, fe460110f045475cbdacef3faa77a3cf
I20260807 02:19:46.470456 23319 raft_consensus.cc:2726] T edf4179495aa43c8bef305740acaf626 P cba95a7085104eb988dda6fc2d029a57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:19:47.056337 23320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:47.055896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.193:44939)
0807 02:19:47.056176 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:47.056236 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":90,"threads_started":1}
I20260807 02:19:47.190970 23321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:47.190569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.194:60277)
0807 02:19:47.190812 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:47.190861 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":68,"threads_started":1}
I20260807 02:19:47.358530 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 22672
I20260807 02:19:47.370697 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 22900
I20260807 02:19:47.374778 23322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:47.370346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36675 (local address 127.1.126.195:43659)
0807 02:19:47.370696 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:47.370774 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:36675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":73,"threads_started":1}
I20260807 02:19:47.380939 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 23071
2026-08-07T02:19:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19473 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:19:47 dist-test-slave-39l8 krb5kdc[23325](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:19:47 dist-test-slave-39l8 krb5kdc[23325](info): set up 2 sockets
Aug 07 02:19:47 dist-test-slave-39l8 krb5kdc[23325](info): commencing operation
krb5kdc: starting...
W20260807 02:19:48.565590 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:19:48 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:19:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:19:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:19:48.685362 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42303
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:48.797241 23340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:48.797472 23340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:48.797510 23340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:48.801337 23340 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 02:19:48.801383 23340 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 02:19:48.801397 23340 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 02:19:48.801411 23340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:19:48.801429 23340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:48.801446 23340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:48.801461 23340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:19:48.801476 23340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:19:48.806566 23340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:48.807619 23340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:48.808581 23340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:48.817152 23350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:48.817111 23349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:48.817260 23340 server_base.cc:1034] running on GCE node
W20260807 02:19:48.817111 23352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:48.817945 23340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:48.819059 23340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:48.820250 23340 hybrid_clock.cc:648] HybridClock initialized: now 1786069188820229 us; error 43 us; skew 500 ppm
Aug 07 02:19:48 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069188, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:48.822894 23340 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:19:48.823755 23340 webserver.cc:460] Webserver started at http://127.1.126.254:45391/ using document root <none> and password file <none>
I20260807 02:19:48.824311 23340 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:48.824398 23340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:48.824635 23340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:48.826651 23340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "971f5a54241944b08dbc1131d98dd2a0"
format_stamp: "Formatted at 2026-08-07 02:19:48 on dist-test-slave-39l8"
server_key: "a945895035e4428762ec51ec81dd23a5"
server_key_iv: "5d8f823c05081bdedae63ba55e50a626"
server_key_version: "encryptionkey@0"
I20260807 02:19:48.827255 23340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "971f5a54241944b08dbc1131d98dd2a0"
format_stamp: "Formatted at 2026-08-07 02:19:48 on dist-test-slave-39l8"
server_key: "a945895035e4428762ec51ec81dd23a5"
server_key_iv: "5d8f823c05081bdedae63ba55e50a626"
server_key_version: "encryptionkey@0"
I20260807 02:19:48.830875 23340 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:48.833227 23362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:48.834365 23340 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:48.834504 23340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "971f5a54241944b08dbc1131d98dd2a0"
format_stamp: "Formatted at 2026-08-07 02:19:48 on dist-test-slave-39l8"
server_key: "a945895035e4428762ec51ec81dd23a5"
server_key_iv: "5d8f823c05081bdedae63ba55e50a626"
server_key_version: "encryptionkey@0"
I20260807 02:19:48.834609 23340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:48.856714 23340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:48.859648 23340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:48.859849 23340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:48.867192 23340 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:42303
I20260807 02:19:48.867491 23432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:42303 every 8 connection(s)
I20260807 02:19:48.868222 23340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:19:48.871025 23433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:48.871364 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 23340
I20260807 02:19:48.871486 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:19:48.871781 1531 external_mini_cluster.cc:1428] Setting key 836fa37a1fce68ad48c67bc6abf7098f
I20260807 02:19:48.878276 23433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap starting.
I20260807 02:19:48.880672 23433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Neither blocks nor log segments found. Creating new log.
Aug 07 02:19:48 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:48.881445 23433 log.cc:824] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:48.883285 23433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: No bootstrap required, opened a new log
I20260807 02:19:48.886147 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:48.873185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41662 (local address 127.1.126.254:42303)
0807 02:19:48.873604 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:48.873624 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:48.873676 (+ 52us) server_negotiation.cc:407] Connection header received
0807 02:19:48.874453 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:48.874477 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:48.874938 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:48.875300 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:48.875929 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:48.877467 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:48.878405 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:48.879113 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:48.879269 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:48.881662 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:48.881667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:48.881680 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:48.881707 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:48.883415 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:48.883869 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:48.883880 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:48.883884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:48.883993 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:48.884283 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:48.884287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:48.884289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:48.884677 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:48.884882 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:48.885178 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 02:19:48.885458 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":106,"threads_started":1}
I20260807 02:19:48.886933 23433 raft_consensus.cc:348] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:19:48.887179 23433 raft_consensus.cc:374] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:48.887283 23433 raft_consensus.cc:729] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 971f5a54241944b08dbc1131d98dd2a0, State: Initialized, Role: FOLLOWER
I20260807 02:19:48.887735 23433 consensus_queue.cc:260] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:19:48.887890 23433 raft_consensus.cc:388] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:19:48.887951 23433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:19:48.888043 23433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:48.888993 23433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:19:48.889276 23433 leader_election.cc:302] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 971f5a54241944b08dbc1131d98dd2a0; no voters:
I20260807 02:19:48.889528 23433 leader_election.cc:288] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:19:48.889719 23442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:48.889967 23442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 971f5a54241944b08dbc1131d98dd2a0, State: Running, Role: LEADER
I20260807 02:19:48.890285 23442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:19:48.890785 23433 sys_catalog.cc:564] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:19:48.892012 23445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 971f5a54241944b08dbc1131d98dd2a0. Latest consensus state: current_term: 1 leader_uuid: "971f5a54241944b08dbc1131d98dd2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } } }
I20260807 02:19:48.892122 23443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "971f5a54241944b08dbc1131d98dd2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } } }
I20260807 02:19:48.892200 23445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:48.892200 23443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:19:48.892599 23460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:19:48.895732 23460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:19:48.901276 23460 catalog_manager.cc:1347] Generated new cluster ID: 2fce4c2d9a9d4b0abe4132870715cf74
I20260807 02:19:48.901352 23460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:19:48.910161 23460 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:19:48.911417 23460 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:19:48.919898 23460 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Generated new TSK 0
I20260807 02:19:48.920528 23460 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:19:48.954886 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42303
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:49.065830 23473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:49.066072 23473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:49.066119 23473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:49.070133 23473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:49.070187 23473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:49.070241 23473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:19:49.075445 23473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:49.076421 23473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:49.077359 23473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:49.086656 23480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:49.086730 23481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:49.086665 23484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:49.086848 23473 server_base.cc:1034] running on GCE node
I20260807 02:19:49.087466 23473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:49.088084 23473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:49.089272 23473 hybrid_clock.cc:648] HybridClock initialized: now 1786069189089257 us; error 31 us; skew 500 ppm
Aug 07 02:19:49 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069189, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:49.092314 23473 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:19:49.093192 23473 webserver.cc:460] Webserver started at http://127.1.126.193:41187/ using document root <none> and password file <none>
I20260807 02:19:49.093710 23473 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:49.093767 23473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:49.093924 23473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:49.095892 23473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "39a45bc130d5477abfb0bd847a4de6db"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "fc3cb7e8669f2e70ae61a5d4e035e294"
server_key_iv: "5a969b2e5d045a2f81563a697612e138"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.096390 23473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "39a45bc130d5477abfb0bd847a4de6db"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "fc3cb7e8669f2e70ae61a5d4e035e294"
server_key_iv: "5a969b2e5d045a2f81563a697612e138"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.099888 23473 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:49.102105 23494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.103349 23473 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:19:49.103490 23473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "39a45bc130d5477abfb0bd847a4de6db"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "fc3cb7e8669f2e70ae61a5d4e035e294"
server_key_iv: "5a969b2e5d045a2f81563a697612e138"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.103595 23473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:49.119452 23473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:49.122581 23473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:49.122818 23473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:49.123421 23473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:49.124248 23473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:49.124312 23473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.124367 23473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:49.124392 23473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.133020 23473 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:40281
I20260807 02:19:49.133044 23652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:40281 every 8 connection(s)
I20260807 02:19:49.133993 23473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:19:49.141609 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 23473
I20260807 02:19:49.141767 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:19:49.142068 1531 external_mini_cluster.cc:1428] Setting key d6169dc24cb5045a844b8ffeca1fc8be
Aug 07 02:19:49 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069189, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:49.147337 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.135726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:40759 (local address 127.1.126.254:42303)
0807 02:19:49.135872 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.135876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.136813 (+ 937us) server_negotiation.cc:407] Connection header received
0807 02:19:49.137670 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.137673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.137728 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.137828 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:49.138963 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.139490 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.140599 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.140832 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.140940 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.143584 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:49.143587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:49.143590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:49.143626 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:49.145295 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.145809 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.145812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.145813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.145897 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.146247 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.146250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.146252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.146422 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:49.146525 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.147051 (+ 526us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.147175 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:19:49.148293 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.136087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:40759)
0807 02:19:49.136682 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.136718 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.137483 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.137988 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.137995 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.138357 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:49.138833 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.138846 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.139631 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.139634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.140481 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.140489 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.140989 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.140993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.141165 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.141780 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:49.141796 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:49.143417 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:49.145412 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:49.145417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:49.145427 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:49.145680 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:49.146004 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:49.146007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:49.146009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:49.146141 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:49.146534 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:49.146543 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:49.146812 (+ 269us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.146987 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.147282 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":102,"threads_started":1}
I20260807 02:19:49.149487 23653 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42303
I20260807 02:19:49.149715 23653 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:49.150171 23653 heartbeater.cc:511] Master 127.1.126.254:42303 requested a full tablet report, sending...
I20260807 02:19:49.151654 23383 ts_manager.cc:194] Registered new tserver with Master: 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193:40281)
I20260807 02:19:49.152786 23383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:40759
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:19:49.169773 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42303
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:49.281798 23660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:49.282091 23660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:49.282171 23660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:49.286170 23660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:49.286258 23660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:49.286350 23660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:19:49.291510 23660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:49.292624 23660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:49.293685 23660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:19:49.302923 23667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:49.302953 23672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:49.302923 23670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:49.303190 23660 server_base.cc:1034] running on GCE node
I20260807 02:19:49.303640 23660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:49.304184 23660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:49.305384 23660 hybrid_clock.cc:648] HybridClock initialized: now 1786069189305371 us; error 26 us; skew 500 ppm
Aug 07 02:19:49 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069189, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:49.308336 23660 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:19:49.309146 23660 webserver.cc:460] Webserver started at http://127.1.126.194:40285/ using document root <none> and password file <none>
I20260807 02:19:49.309705 23660 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:49.309792 23660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:49.310025 23660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:49.311956 23660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "072d457a243411c0041c035eed822be8"
server_key_iv: "d983e48eed2cb2448fcf181d237d23c1"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.312525 23660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "072d457a243411c0041c035eed822be8"
server_key_iv: "d983e48eed2cb2448fcf181d237d23c1"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.316058 23660 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:19:49.318295 23682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.319557 23660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:19:49.319692 23660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "072d457a243411c0041c035eed822be8"
server_key_iv: "d983e48eed2cb2448fcf181d237d23c1"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.319798 23660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:49.334097 23660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:49.336972 23660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:49.337153 23660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:49.337749 23660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:49.338636 23660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:49.338735 23660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.338820 23660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:49.338867 23660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.347357 23660 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:37533
I20260807 02:19:49.347378 23837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:37533 every 8 connection(s)
I20260807 02:19:49.348213 23660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:19:49.356014 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 23660
I20260807 02:19:49.356176 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:19:49.356447 1531 external_mini_cluster.cc:1428] Setting key 2d076f500e1e3bea2e362974c7a801c2
Aug 07 02:19:49 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069189, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:49.361130 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.350011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:36497 (local address 127.1.126.254:42303)
0807 02:19:49.350155 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.350159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.351189 (+ 1030us) server_negotiation.cc:407] Connection header received
0807 02:19:49.352027 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.352030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.352096 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.352169 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:49.353248 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.353799 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.354923 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.355132 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.355214 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.357815 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:49.357818 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:49.357820 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:49.357842 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:49.359197 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.359684 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.359692 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.359693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.359763 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.360085 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.360089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.360091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.360264 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:49.360366 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.360847 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.360967 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:19:49.361896 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.350380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:36497)
0807 02:19:49.351053 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.351093 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.351843 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.352318 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.352324 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.352664 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:49.353127 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.353139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.353894 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.353896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.354779 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.354807 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.355258 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.355261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.355398 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.355979 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:49.355995 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:49.357633 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:49.359312 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:49.359318 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:49.359331 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:49.359577 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:49.359851 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:49.359856 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:49.359857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:49.359990 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:49.360367 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:49.360374 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:49.360630 (+ 256us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.360807 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.361094 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":115,"threads_started":1}
I20260807 02:19:49.363127 23838 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42303
I20260807 02:19:49.363365 23838 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:49.363823 23838 heartbeater.cc:511] Master 127.1.126.254:42303 requested a full tablet report, sending...
I20260807 02:19:49.364945 23383 ts_manager.cc:194] Registered new tserver with Master: 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533)
I20260807 02:19:49.365757 23383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:36497
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:19:49.383225 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42303
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:19:49.496896 23847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:19:49.497169 23847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:19:49.497254 23847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:19:49.501297 23847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:19:49.501377 23847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:19:49.501477 23847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:19:49.506910 23847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:19:49.507925 23847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:19:49.508875 23847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:19:49.518384 23847 server_base.cc:1034] running on GCE node
W20260807 02:19:49.518483 23857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:49.518537 23858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:19:49.518368 23860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:19:49.519040 23847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:19:49.519604 23847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:19:49.520789 23847 hybrid_clock.cc:648] HybridClock initialized: now 1786069189520764 us; error 39 us; skew 500 ppm
Aug 07 02:19:49 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069189, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:19:49.523543 23847 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:19:49.524400 23847 webserver.cc:460] Webserver started at http://127.1.126.195:45327/ using document root <none> and password file <none>
I20260807 02:19:49.524995 23847 fs_manager.cc:359] Metadata directory not provided
I20260807 02:19:49.525084 23847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:19:49.525307 23847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:19:49.527314 23847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "a6bd866a574f403f919379866931091d"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "f1714c9cea99358fa78a9a94cca4c72c"
server_key_iv: "717b41cb1ffca3032999291a7011354f"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.527855 23847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "a6bd866a574f403f919379866931091d"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "f1714c9cea99358fa78a9a94cca4c72c"
server_key_iv: "717b41cb1ffca3032999291a7011354f"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.531411 23847 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:19:49.533689 23870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.534922 23847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:19:49.535046 23847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a6bd866a574f403f919379866931091d"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "f1714c9cea99358fa78a9a94cca4c72c"
server_key_iv: "717b41cb1ffca3032999291a7011354f"
server_key_version: "encryptionkey@0"
I20260807 02:19:49.535152 23847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:19:49.557121 23847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:19:49.560407 23847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:19:49.560627 23847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:19:49.561242 23847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:19:49.562096 23847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:19:49.562166 23847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.562235 23847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:19:49.562282 23847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:19:49.571260 23847 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:35855
I20260807 02:19:49.571290 24016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:35855 every 8 connection(s)
I20260807 02:19:49.572117 23847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:19:49.579347 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 23847
I20260807 02:19:49.579487 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:19:49.579818 1531 external_mini_cluster.cc:1428] Setting key db5b66b6c0b31fa58da0b0bee68eed06
Aug 07 02:19:49 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069189, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:19:49.584585 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.573881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:43781 (local address 127.1.126.254:42303)
0807 02:19:49.574007 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.574010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.574981 (+ 971us) server_negotiation.cc:407] Connection header received
0807 02:19:49.575804 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.575807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.575855 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.575930 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:49.576991 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.577503 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.578521 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.578740 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.578814 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.581510 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:49.581513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:49.581515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:49.581536 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:49.582936 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.583395 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.583398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.583399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.583469 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.583740 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.583742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.583744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.583898 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:49.583972 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.584383 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.584473 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:19:49.585397 24020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.574167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:43781)
0807 02:19:49.574854 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.574897 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.575632 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.576093 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.576099 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.576417 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:19:49.576865 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.576889 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.577599 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.577602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.578422 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.578431 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.578849 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.578852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.578983 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.579590 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:19:49.579621 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:19:49.581369 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:19:49.583044 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:49.583049 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:49.583060 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:49.583314 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:49.583542 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:19:49.583543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:19:49.583545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:19:49.583666 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:19:49.583979 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:19:49.583984 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:19:49.584194 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.584338 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.584556 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":112,"threads_started":1}
I20260807 02:19:49.586452 24018 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42303
I20260807 02:19:49.586651 24018 heartbeater.cc:464] Registering TS with master...
I20260807 02:19:49.587108 24018 heartbeater.cc:511] Master 127.1.126.254:42303 requested a full tablet report, sending...
I20260807 02:19:49.588027 23383 ts_manager.cc:194] Registered new tserver with Master: a6bd866a574f403f919379866931091d (127.1.126.195:35855)
I20260807 02:19:49.588523 23383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:43781
I20260807 02:19:49.593564 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:19:49.602097 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.595540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41678 (local address 127.1.126.254:42303)
0807 02:19:49.595661 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.595665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.595850 (+ 185us) server_negotiation.cc:407] Connection header received
0807 02:19:49.595961 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.595963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.595999 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.596067 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:19:49.596679 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.597140 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.597875 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.598064 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.598132 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.599458 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:19:49.599461 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:19:49.599463 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:19:49.599484 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:19:49.600681 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.601049 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.601051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.601052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.601121 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:19:49.601334 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:19:49.601336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:19:49.601337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:19:49.601539 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:19:49.601666 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.601899 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.601988 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:19:49.604629 23383 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:19:49.607802 23383 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:19:49.621932 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.617252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:37533 (local address 127.0.0.1:42642)
0807 02:19:49.617665 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.617677 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.617768 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.618434 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.618437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.618455 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:49.618572 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.618582 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.619698 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.619702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.620599 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.620610 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.621439 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.621442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.621549 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.621586 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.621688 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.621788 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":53,"thread_start_us":87,"threads_started":1}
I20260807 02:19:49.621951 24039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.617670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42642 (local address 127.1.126.194:37533)
0807 02:19:49.618002 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.618014 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.618070 (+ 56us) server_negotiation.cc:407] Connection header received
0807 02:19:49.618146 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.618152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.618311 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.618454 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:49.618697 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.619566 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.620742 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.621319 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.621421 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.621569 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.621728 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.621818 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":99,"threads_started":1}
I20260807 02:19:49.622494 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.616092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40281 (local address 127.0.0.1:35710)
0807 02:19:49.616611 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.616663 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.616793 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.617786 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.617794 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.617823 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:49.618070 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.618083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.619524 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.619530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.621126 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.621138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.622158 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.622163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.622243 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.622263 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.622302 (+ 39us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.622369 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":218,"thread_start_us":197,"threads_started":1}
I20260807 02:19:49.622685 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.617105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36370 (local address 127.1.126.195:35855)
0807 02:19:49.617481 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.617492 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.617513 (+ 21us) server_negotiation.cc:407] Connection header received
0807 02:19:49.617580 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.617585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.617749 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.618235 (+ 486us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:49.618385 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.619421 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.621269 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.622013 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.622186 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.622315 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.622411 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.622490 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":95,"threads_started":1}
I20260807 02:19:49.623009 24036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.616928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:35855 (local address 127.0.0.1:36370)
0807 02:19:49.617376 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.617390 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.617480 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.617880 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.617883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.617896 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:49.618105 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.618114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.619546 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.619549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.621126 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.621138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.622189 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.622193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.622282 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.622303 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.622383 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.622452 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":232,"thread_start_us":103,"threads_started":1}
I20260807 02:19:49.623100 24034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.616506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.1.126.193:40281)
0807 02:19:49.617196 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.617213 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.617298 (+ 85us) server_negotiation.cc:407] Connection header received
0807 02:19:49.617383 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.617390 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.617607 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.617997 (+ 390us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:49.618174 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.619368 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.621281 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.622022 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.622738 (+ 716us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.622860 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.622903 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.622972 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":125,"threads_started":1}
I20260807 02:19:49.625253 23747 tablet_service.cc:1467] Processing CreateTablet for tablet 57f0486af35445cdbb9273a059b30190 (DEFAULT_TABLE table=test-table [id=8cda9cc1efe542e088c3b4b09ea07ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:49.625633 23558 tablet_service.cc:1467] Processing CreateTablet for tablet 57f0486af35445cdbb9273a059b30190 (DEFAULT_TABLE table=test-table [id=8cda9cc1efe542e088c3b4b09ea07ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:49.626418 23747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57f0486af35445cdbb9273a059b30190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:49.626076 23927 tablet_service.cc:1467] Processing CreateTablet for tablet 57f0486af35445cdbb9273a059b30190 (DEFAULT_TABLE table=test-table [id=8cda9cc1efe542e088c3b4b09ea07ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:19:49.626538 23558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57f0486af35445cdbb9273a059b30190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:49.626996 23927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57f0486af35445cdbb9273a059b30190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:19:49.632074 24041 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap starting.
I20260807 02:19:49.633430 24044 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Bootstrap starting.
I20260807 02:19:49.633822 24045 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Bootstrap starting.
I20260807 02:19:49.634675 24041 tablet_bootstrap.cc:654] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:49.636215 24041 log.cc:824] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:49.636421 24044 tablet_bootstrap.cc:654] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:49.636708 24045 tablet_bootstrap.cc:654] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Neither blocks nor log segments found. Creating new log.
I20260807 02:19:49.637475 24045 log.cc:824] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:49.637535 24044 log.cc:824] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Log is configured to *not* fsync() on all Append() calls
I20260807 02:19:49.638612 24041 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: No bootstrap required, opened a new log
I20260807 02:19:49.638840 24041 ts_tablet_manager.cc:1397] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 02:19:49.639811 24044 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: No bootstrap required, opened a new log
I20260807 02:19:49.639978 24044 ts_tablet_manager.cc:1397] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 02:19:49.641703 24041 raft_consensus.cc:348] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.641921 24041 raft_consensus.cc:374] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:49.641985 24041 raft_consensus.cc:729] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a45bc130d5477abfb0bd847a4de6db, State: Initialized, Role: FOLLOWER
I20260807 02:19:49.642390 24041 consensus_queue.cc:260] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.642596 24044 raft_consensus.cc:348] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.643054 23653 heartbeater.cc:503] Master 127.1.126.254:42303 was elected leader, sending a full tablet report...
I20260807 02:19:49.643352 24041 ts_tablet_manager.cc:1428] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 02:19:49.643520 24044 raft_consensus.cc:374] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:49.643631 24044 raft_consensus.cc:729] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bd866a574f403f919379866931091d, State: Initialized, Role: FOLLOWER
I20260807 02:19:49.644106 24045 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: No bootstrap required, opened a new log
I20260807 02:19:49.644094 24044 consensus_queue.cc:260] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.644284 24045 ts_tablet_manager.cc:1397] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260807 02:19:49.644731 24018 heartbeater.cc:503] Master 127.1.126.254:42303 was elected leader, sending a full tablet report...
I20260807 02:19:49.645030 24044 ts_tablet_manager.cc:1428] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:19:49.647809 24045 raft_consensus.cc:348] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.648120 24045 raft_consensus.cc:374] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:19:49.648188 24045 raft_consensus.cc:729] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb2a6d3b8f04fdab15b68928c503b1b, State: Initialized, Role: FOLLOWER
I20260807 02:19:49.648521 24045 consensus_queue.cc:260] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.649099 23838 heartbeater.cc:503] Master 127.1.126.254:42303 was elected leader, sending a full tablet report...
I20260807 02:19:49.649286 24045 ts_tablet_manager.cc:1428] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:19:49.668735 24050 raft_consensus.cc:482] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:19:49.668926 24050 raft_consensus.cc:504] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.669898 24050 leader_election.cc:288] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6bd866a574f403f919379866931091d (127.1.126.195:35855), 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533)
I20260807 02:19:49.675057 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.670240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:40251 (local address 127.1.126.195:35855)
0807 02:19:49.670360 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.670363 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.670439 (+ 76us) server_negotiation.cc:407] Connection header received
0807 02:19:49.670655 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.670658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.670732 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.670816 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:49.671137 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.671903 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.673730 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.674312 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.674428 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.674477 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.674846 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.674934 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:19:49.675058 24039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.670630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38107 (local address 127.1.126.194:37533)
0807 02:19:49.670789 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.670796 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.670906 (+ 110us) server_negotiation.cc:407] Connection header received
0807 02:19:49.671012 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.671014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.671049 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.671132 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:19:49.671358 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.672048 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.673730 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.674312 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.674428 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.674477 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.674846 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.674934 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:19:49.675145 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.670497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:37533 (local address 127.1.126.193:38107)
0807 02:19:49.670817 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.670831 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.670936 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.671145 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.671148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.671165 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:49.671258 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.671262 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.672193 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.672196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.673597 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.673608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.674435 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.674439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.674653 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.674735 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.674818 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.674972 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":263,"spinlock_wait_cycles":3072,"thread_start_us":115,"threads_started":1}
I20260807 02:19:49.675149 24053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.670115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:35855 (local address 127.1.126.193:40251)
0807 02:19:49.670360 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.670376 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:19:49.670481 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:19:49.670846 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:19:49.670853 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:19:49.670878 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:19:49.671040 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.671046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.672039 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.672042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.673597 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:19:49.673608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.674435 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.674439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:19:49.674658 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.674735 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 02:19:49.674818 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:19:49.674977 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":216,"spinlock_wait_cycles":7040,"thread_start_us":97,"threads_started":1}
I20260807 02:19:49.675899 23952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57f0486af35445cdbb9273a059b30190" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bd866a574f403f919379866931091d" is_pre_election: true
I20260807 02:19:49.676007 23780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57f0486af35445cdbb9273a059b30190" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" is_pre_election: true
I20260807 02:19:49.676180 23952 raft_consensus.cc:2454] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 0.
I20260807 02:19:49.676321 23780 raft_consensus.cc:2454] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 0.
I20260807 02:19:49.676636 23498 leader_election.cc:302] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db, a6bd866a574f403f919379866931091d; no voters:
I20260807 02:19:49.676887 24050 raft_consensus.cc:2781] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:19:49.676962 24050 raft_consensus.cc:482] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:19:49.676991 24050 raft_consensus.cc:3037] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:49.677969 24050 raft_consensus.cc:504] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.678272 24050 leader_election.cc:288] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 election: Requested vote from peers a6bd866a574f403f919379866931091d (127.1.126.195:35855), 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533)
I20260807 02:19:49.678591 23952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57f0486af35445cdbb9273a059b30190" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bd866a574f403f919379866931091d"
I20260807 02:19:49.678627 23780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57f0486af35445cdbb9273a059b30190" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
I20260807 02:19:49.678682 23952 raft_consensus.cc:3037] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:49.678810 23780 raft_consensus.cc:3037] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:19:49.679733 23952 raft_consensus.cc:2454] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 1.
I20260807 02:19:49.679862 23780 raft_consensus.cc:2454] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 1.
I20260807 02:19:49.680045 23498 leader_election.cc:302] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db, a6bd866a574f403f919379866931091d; no voters:
I20260807 02:19:49.680231 24050 raft_consensus.cc:2781] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:19:49.680459 24050 raft_consensus.cc:686] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 LEADER]: Becoming Leader. State: Replica: 39a45bc130d5477abfb0bd847a4de6db, State: Running, Role: LEADER
I20260807 02:19:49.680747 24050 consensus_queue.cc:237] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:19:49.683630 23383 catalog_manager.cc:5495] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193). New cstate: current_term: 1 leader_uuid: "39a45bc130d5477abfb0bd847a4de6db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } health_report { overall_health: UNKNOWN } } }
I20260807 02:19:49.707971 24034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.704668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35720 (local address 127.1.126.193:40281)
0807 02:19:49.704780 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 02:19:49.704784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:19:49.704796 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:19:49.704942 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:19:49.704945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:19:49.704997 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:19:49.705092 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:19:49.705304 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.705789 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.706568 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:19:49.706865 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:19:49.706938 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:19:49.707230 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:19:49.707619 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:19:49.707716 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 02:19:49.707772 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 02:19:49.707816 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 02:19:49.713385 23780 raft_consensus.cc:1261] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Refusing update from remote peer 39a45bc130d5477abfb0bd847a4de6db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:49.713387 23952 raft_consensus.cc:1261] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Refusing update from remote peer 39a45bc130d5477abfb0bd847a4de6db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:19:49.714035 24050 consensus_queue.cc:1035] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:49.714241 24055 consensus_queue.cc:1035] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:19:49.721351 24058 mvcc.cc:205] Tried to move back new op lower bound from 7315739401059373056 to 7315739400935034880. Current Snapshot: MvccSnapshot[applied={T|T < 7315739401059373056}]
I20260807 02:19:49.722065 24059 mvcc.cc:205] Tried to move back new op lower bound from 7315739401059373056 to 7315739400935034880. Current Snapshot: MvccSnapshot[applied={T|T < 7315739401059373056}]
I20260807 02:19:49.722368 24060 mvcc.cc:205] Tried to move back new op lower bound from 7315739401059373056 to 7315739400935034880. Current Snapshot: MvccSnapshot[applied={T|T < 7315739401059373056}]
I20260807 02:19:49.730032 23381 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:49.730201 23381 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:19:49.732504 23381 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Sending DeleteTablet for 3 replicas of tablet 57f0486af35445cdbb9273a059b30190
I20260807 02:19:49.733233 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 23473
I20260807 02:19:49.733309 23927 tablet_service.cc:1514] Processing DeleteTablet for tablet 57f0486af35445cdbb9273a059b30190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:36370
I20260807 02:19:49.733381 23558 tablet_service.cc:1514] Processing DeleteTablet for tablet 57f0486af35445cdbb9273a059b30190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:35710
I20260807 02:19:49.734014 23747 tablet_service.cc:1514] Processing DeleteTablet for tablet 57f0486af35445cdbb9273a059b30190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:42642
I20260807 02:19:49.735587 24072 tablet_replica.cc:330] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: stopping tablet replica
I20260807 02:19:49.735884 24072 raft_consensus.cc:2229] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:49.736147 24072 raft_consensus.cc:2258] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:49.738072 24072 ts_tablet_manager.cc:1905] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:49.739135 24070 tablet_replica.cc:330] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: stopping tablet replica
I20260807 02:19:49.739593 24070 raft_consensus.cc:2229] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:19:49.739981 24070 raft_consensus.cc:2258] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:19:49.740790 24072 ts_tablet_manager.cc:1918] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:49.740859 24072 log.cc:1196] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/57f0486af35445cdbb9273a059b30190
I20260807 02:19:49.741091 24072 ts_tablet_manager.cc:1939] T 57f0486af35445cdbb9273a059b30190 P 3fb2a6d3b8f04fdab15b68928c503b1b: Deleting consensus metadata
I20260807 02:19:49.742058 23364 catalog_manager.cc:4841] TS 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): tablet 57f0486af35445cdbb9273a059b30190 (table test-table [id=8cda9cc1efe542e088c3b4b09ea07ff9]) successfully deleted
I20260807 02:19:49.742116 24070 ts_tablet_manager.cc:1905] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:19:49.745093 24070 ts_tablet_manager.cc:1918] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:19:49.745206 24070 log.cc:1196] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/57f0486af35445cdbb9273a059b30190
I20260807 02:19:49.745591 24070 ts_tablet_manager.cc:1939] T 57f0486af35445cdbb9273a059b30190 P a6bd866a574f403f919379866931091d: Deleting consensus metadata
I20260807 02:19:49.746630 23364 catalog_manager.cc:4841] TS a6bd866a574f403f919379866931091d (127.1.126.195:35855): tablet 57f0486af35445cdbb9273a059b30190 (table test-table [id=8cda9cc1efe542e088c3b4b09ea07ff9]) successfully deleted
W20260807 02:19:49.751585 23364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:40281 (error 108)
I20260807 02:19:49.751700 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 23660
I20260807 02:19:49.757385 24036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:19:49.756886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40281 (local address 127.0.0.1:35732)
0807 02:19:49.757154 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 02:19:49.757259 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260807 02:19:49.757604 23364 catalog_manager.cc:4584] TS 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193:40281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 57f0486af35445cdbb9273a059b30190: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40281: connect: Connection refused (error 111)
I20260807 02:19:49.762576 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 23847
I20260807 02:19:49.782635 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 23340
I20260807 02:20:09.793763 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42303
--webserver_interface=127.1.126.254
--webserver_port=45391
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:09.912770 24075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:09.913039 24075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:09.913079 24075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:09.917188 24075 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 02:20:09.917238 24075 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 02:20:09.917254 24075 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 02:20:09.917268 24075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:09.917308 24075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:09.917344 24075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:09.917379 24075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:09.917419 24075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:09.922474 24075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=45391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:09.923522 24075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:09.924553 24075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:09.938777 24082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:09.938776 24083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:09.938975 24075 server_base.cc:1034] running on GCE node
W20260807 02:20:09.938776 24087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:09.939728 24075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:09.940838 24075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:09.942046 24075 hybrid_clock.cc:648] HybridClock initialized: now 1786069209941988 us; error 42 us; skew 500 ppm
Aug 07 02:20:09 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069209, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:09.944805 24075 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:20:09.945677 24075 webserver.cc:460] Webserver started at http://127.1.126.254:45391/ using document root <none> and password file <none>
I20260807 02:20:09.946213 24075 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:09.946282 24075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:09.950110 24075 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:09.952303 24098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:09.953504 24075 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:20:09.953617 24075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "971f5a54241944b08dbc1131d98dd2a0"
format_stamp: "Formatted at 2026-08-07 02:19:48 on dist-test-slave-39l8"
server_key: "a945895035e4428762ec51ec81dd23a5"
server_key_iv: "5d8f823c05081bdedae63ba55e50a626"
server_key_version: "encryptionkey@0"
I20260807 02:20:09.954182 24075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:09.988477 24075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:09.991492 24075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:09.991652 24075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:09.999797 24075 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:42303
I20260807 02:20:10.000105 24164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:42303 every 8 connection(s)
I20260807 02:20:10.000934 24075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:10.002653 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 24075
I20260807 02:20:10.003201 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:40281
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:42303
--webserver_port=41187
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:20:10.006369 24165 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:20:10.008208 24165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap starting.
I20260807 02:20:10.031035 24165 log.cc:824] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:10.040318 24165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:20:10.040783 24165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap complete.
I20260807 02:20:10.044859 24165 raft_consensus.cc:348] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:10.045262 24165 raft_consensus.cc:729] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 971f5a54241944b08dbc1131d98dd2a0, State: Initialized, Role: FOLLOWER
I20260807 02:20:10.045749 24165 consensus_queue.cc:260] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:10.045894 24165 raft_consensus.cc:388] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:10.045992 24165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:10.046092 24165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 02:20:10.048803 24165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:10.049269 24165 leader_election.cc:302] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 971f5a54241944b08dbc1131d98dd2a0; no voters:
I20260807 02:20:10.049690 24165 leader_election.cc:288] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 02:20:10.049868 24169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 02:20:10.050146 24169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 LEADER]: Becoming Leader. State: Replica: 971f5a54241944b08dbc1131d98dd2a0, State: Running, Role: LEADER
I20260807 02:20:10.050482 24169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:10.050993 24165 sys_catalog.cc:564] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:10.051580 24169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "971f5a54241944b08dbc1131d98dd2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } } }
I20260807 02:20:10.051797 24169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:10.052119 24169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 971f5a54241944b08dbc1131d98dd2a0. Latest consensus state: current_term: 2 leader_uuid: "971f5a54241944b08dbc1131d98dd2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } } }
I20260807 02:20:10.052273 24169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:10.053157 24183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:10.058231 24183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:10.059077 24183 catalog_manager.cc:1259] Loaded cluster ID: 2fce4c2d9a9d4b0abe4132870715cf74
I20260807 02:20:10.059186 24183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:10.061825 24183 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:10.062647 24183 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Loaded TSK: 0
I20260807 02:20:10.079334 24183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Generated new TSK 1
I20260807 02:20:10.079684 24183 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 02:20:10.133638 24167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:10.133885 24167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:10.133925 24167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:10.138080 24167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:10.138140 24167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:10.138235 24167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:10.143549 24167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:40281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=41187
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:10.144524 24167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:10.145502 24167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:10.155795 24207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:10.155761 24204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:10.155782 24205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:10.156355 24167 server_base.cc:1034] running on GCE node
I20260807 02:20:10.156787 24167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:10.157523 24167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:10.158700 24167 hybrid_clock.cc:648] HybridClock initialized: now 1786069210158680 us; error 36 us; skew 500 ppm
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069210, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:10.161743 24167 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:20:10.162848 24167 webserver.cc:460] Webserver started at http://127.1.126.193:41187/ using document root <none> and password file <none>
I20260807 02:20:10.163606 24167 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:10.163723 24167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:10.168800 24167 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 02:20:10.171355 24215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.172637 24167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260807 02:20:10.172781 24167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "39a45bc130d5477abfb0bd847a4de6db"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "fc3cb7e8669f2e70ae61a5d4e035e294"
server_key_iv: "5a969b2e5d045a2f81563a697612e138"
server_key_version: "encryptionkey@0"
I20260807 02:20:10.173316 24167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:10.190649 24167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:10.193945 24167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:10.194149 24167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:10.194796 24167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:10.195957 24223 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 02:20:10.199956 24167 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 02:20:10.200026 24167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260807 02:20:10.200075 24167 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 02:20:10.201713 24167 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 02:20:10.201771 24167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 02:20:10.202031 24223 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap starting.
I20260807 02:20:10.213054 24167 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:40281
I20260807 02:20:10.213078 24367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:40281 every 8 connection(s)
I20260807 02:20:10.214323 24167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:10.221624 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 24167
I20260807 02:20:10.222157 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:37533
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:42303
--webserver_port=40285
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:20:10.222986 24223 log.cc:824] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Log is configured to *not* fsync() on all Append() calls
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069210, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:10.231788 24223 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:20:10.232260 24223 tablet_bootstrap.cc:492] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap complete.
I20260807 02:20:10.233546 24223 ts_tablet_manager.cc:1397] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Time spent bootstrapping tablet: real 0.032s user 0.025s sys 0.004s
I20260807 02:20:10.234434 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.216457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:42903 (local address 127.1.126.254:42303)
0807 02:20:10.216831 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.216851 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.218167 (+ 1316us) server_negotiation.cc:407] Connection header received
0807 02:20:10.218382 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.218391 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.218669 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.219034 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:10.220165 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.221137 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.222468 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.222981 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.223187 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.228292 (+ 5105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:10.228298 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:10.228313 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:10.228345 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:10.230514 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.231255 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.231261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.231267 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.231419 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.231879 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.231882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.231884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.232393 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:10.232536 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.233250 (+ 714us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.233556 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":132,"threads_started":1}
I20260807 02:20:10.234993 24375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.216465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:42903)
0807 02:20:10.217016 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.217087 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.217930 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.219087 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.219095 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.219535 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:10.219965 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.219978 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.221329 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.221332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.222318 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.222333 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.223184 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.223188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.223427 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.225918 (+ 2491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:10.225938 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:10.228025 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:10.230655 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.230665 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.230690 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.231118 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.231537 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.231542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.231546 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.231752 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.232530 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:10.232540 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:10.232885 (+ 345us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.233119 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.233497 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":168,"threads_started":1}
I20260807 02:20:10.236390 24223 raft_consensus.cc:348] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:20:10.236822 24223 raft_consensus.cc:729] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a45bc130d5477abfb0bd847a4de6db, State: Initialized, Role: FOLLOWER
I20260807 02:20:10.237360 24223 consensus_queue.cc:260] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } }
I20260807 02:20:10.237571 24370 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42303
I20260807 02:20:10.237805 24370 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:10.238333 24370 heartbeater.cc:511] Master 127.1.126.254:42303 requested a full tablet report, sending...
I20260807 02:20:10.238353 24223 ts_tablet_manager.cc:1428] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260807 02:20:10.240971 24121 ts_manager.cc:194] Registered new tserver with Master: 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193:40281)
I20260807 02:20:10.244922 24121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:42903
I20260807 02:20:10.247610 24370 heartbeater.cc:503] Master 127.1.126.254:42303 was elected leader, sending a full tablet report...
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069209, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.193@KRBTEST.COM
I20260807 02:20:10.254999 24381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.244257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40281 (local address 127.0.0.1:45104)
0807 02:20:10.244941 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.244975 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.245138 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.245590 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.245596 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.246031 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:10.246136 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.246143 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.247229 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.247234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.247952 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.247967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.248723 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.248730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.248849 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.249505 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:10.249520 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:10.251099 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:10.253294 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.253303 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.253327 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.253565 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.253878 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.253881 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.253882 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.253957 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.254443 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:10.254448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:10.254539 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.254659 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.254877 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":119,"threads_started":1}
I20260807 02:20:10.255127 24382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.244306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45104 (local address 127.1.126.193:40281)
0807 02:20:10.244701 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.244713 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.245249 (+ 536us) server_negotiation.cc:407] Connection header received
0807 02:20:10.245305 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.245309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.245448 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.245585 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:10.246258 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.247102 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.248094 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.248580 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.248696 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.251239 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:10.251248 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:10.251258 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:10.251278 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:10.253189 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.253684 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.253690 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.253692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.253786 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.254046 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.254050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.254051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.254326 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:10.254463 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.254810 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.254971 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":301,"thread_start_us":97,"threads_started":1}
I20260807 02:20:10.256350 24282 tablet_service.cc:1514] Processing DeleteTablet for tablet 57f0486af35445cdbb9273a059b30190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:19:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:45104
I20260807 02:20:10.257421 24383 tablet_replica.cc:330] stopping tablet replica
I20260807 02:20:10.257711 24383 raft_consensus.cc:2229] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:10.257958 24383 raft_consensus.cc:2258] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:10.259085 24383 ts_tablet_manager.cc:1905] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:10.262478 24383 ts_tablet_manager.cc:1918] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:10.262558 24383 log.cc:1196] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal/wals/57f0486af35445cdbb9273a059b30190
I20260807 02:20:10.262887 24383 ts_tablet_manager.cc:1939] T 57f0486af35445cdbb9273a059b30190 P 39a45bc130d5477abfb0bd847a4de6db: Deleting consensus metadata
I20260807 02:20:10.264420 24100 catalog_manager.cc:4841] TS 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193:40281): tablet 57f0486af35445cdbb9273a059b30190 (table test-table [id=8cda9cc1efe542e088c3b4b09ea07ff9]) successfully deleted
W20260807 02:20:10.343801 24378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:10.344081 24378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:10.344177 24378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:10.348206 24378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:10.348281 24378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:10.348402 24378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:10.353727 24378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:37533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=40285
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:10.354743 24378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:10.355722 24378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:10.365370 24390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:10.365370 24394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:10.365401 24396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:10.365408 24378 server_base.cc:1034] running on GCE node
I20260807 02:20:10.365996 24378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:10.366596 24378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:10.367779 24378 hybrid_clock.cc:648] HybridClock initialized: now 1786069210367754 us; error 46 us; skew 500 ppm
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069210, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:10.374778 24378 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:20:10.375672 24378 webserver.cc:460] Webserver started at http://127.1.126.194:40285/ using document root <none> and password file <none>
I20260807 02:20:10.376248 24378 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:10.376365 24378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:10.380276 24378 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 02:20:10.382196 24404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.383431 24378 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:10.383533 24378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "072d457a243411c0041c035eed822be8"
server_key_iv: "d983e48eed2cb2448fcf181d237d23c1"
server_key_version: "encryptionkey@0"
I20260807 02:20:10.383998 24378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:10.395028 24378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:10.397604 24378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:10.397744 24378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:10.398239 24378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:10.399029 24378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:10.399075 24378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.399111 24378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:10.399127 24378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.408150 24378 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:37533
I20260807 02:20:10.408175 24561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:37533 every 8 connection(s)
I20260807 02:20:10.409088 24378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:10.410508 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 24378
I20260807 02:20:10.411022 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:35855
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:42303
--webserver_port=45327
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069210, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:10.423445 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.410899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:54993 (local address 127.1.126.254:42303)
0807 02:20:10.411040 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.411044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.411999 (+ 955us) server_negotiation.cc:407] Connection header received
0807 02:20:10.413695 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.413698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.413744 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.413816 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:10.415248 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.415772 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.416980 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.417224 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.417335 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.419866 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:10.419870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:10.419875 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:10.419905 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:10.421354 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.421881 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.421884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.421885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.421955 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.422288 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.422291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.422293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.422463 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:10.422571 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.423139 (+ 568us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.423271 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:20:10.424170 24565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.411357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:54993)
0807 02:20:10.411848 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.411888 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.413431 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.413994 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.414004 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.414531 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:10.415093 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.415106 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.415904 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.415907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.416843 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.416853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.417386 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.417390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.417589 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.418220 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:10.418236 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:10.419702 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:10.421481 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.421487 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.421500 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.421767 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.422048 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.422052 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.422054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.422188 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.422572 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:10.422579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:10.422895 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.423069 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.423369 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":149,"threads_started":1}
I20260807 02:20:10.425304 24562 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42303
I20260807 02:20:10.425549 24562 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:10.426007 24562 heartbeater.cc:511] Master 127.1.126.254:42303 requested a full tablet report, sending...
I20260807 02:20:10.427080 24121 ts_manager.cc:194] Registered new tserver with Master: 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533)
I20260807 02:20:10.427826 24121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:54993
W20260807 02:20:10.522802 24567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:10.523042 24567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:10.523082 24567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:10.527042 24567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:10.527112 24567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:10.527205 24567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:10.532353 24567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:35855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=45327
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:10.533332 24567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:10.534351 24567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:10.543814 24579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:10.543829 24576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:10.543828 24575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:10.544050 24567 server_base.cc:1034] running on GCE node
I20260807 02:20:10.544610 24567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:10.545258 24567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:10.546414 24567 hybrid_clock.cc:648] HybridClock initialized: now 1786069210546401 us; error 31 us; skew 500 ppm
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069210, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:10.549252 24567 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:20:10.550132 24567 webserver.cc:460] Webserver started at http://127.1.126.195:45327/ using document root <none> and password file <none>
I20260807 02:20:10.550697 24567 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:10.550907 24567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:10.555261 24567 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:20:10.557332 24588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.558643 24567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:10.558799 24567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a6bd866a574f403f919379866931091d"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "f1714c9cea99358fa78a9a94cca4c72c"
server_key_iv: "717b41cb1ffca3032999291a7011354f"
server_key_version: "encryptionkey@0"
I20260807 02:20:10.559345 24567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:10.575629 24567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:10.579123 24567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:10.579317 24567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:10.579857 24567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:10.580693 24567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:10.580741 24567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.580804 24567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:10.580840 24567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:10.589434 24567 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:35855
I20260807 02:20:10.589505 24739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:35855 every 8 connection(s)
I20260807 02:20:10.590385 24567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:10.598845 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 24567
Aug 07 02:20:10 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069210, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:10.603585 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.592109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:39919 (local address 127.1.126.254:42303)
0807 02:20:10.592297 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.592302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.593299 (+ 997us) server_negotiation.cc:407] Connection header received
0807 02:20:10.594187 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.594190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.594234 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.594305 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:10.595491 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.595988 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.597038 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.597254 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.597329 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.599899 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:10.599906 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:10.599912 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:10.599942 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:10.601638 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.602117 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.602120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.602122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.602209 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.602555 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.602558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.602560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.602768 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:10.602857 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.603312 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.603421 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 02:20:10.604281 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.592531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:39919)
0807 02:20:10.593160 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.593200 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.593962 (+ 762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.594463 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.594468 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.594867 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:10.595367 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.595380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.596090 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.596092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.596933 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.596943 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.597378 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.597381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.597511 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.598020 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:10.598035 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:10.599734 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:10.601753 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.601759 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.601772 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.602009 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.602301 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:10.602305 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:10.602307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:10.602441 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:10.602856 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:10.602863 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:10.603072 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.603266 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.603552 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":113,"threads_started":1}
I20260807 02:20:10.605504 24741 heartbeater.cc:347] Connected to a master server at 127.1.126.254:42303
I20260807 02:20:10.605743 24741 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:10.606226 24741 heartbeater.cc:511] Master 127.1.126.254:42303 requested a full tablet report, sending...
I20260807 02:20:10.607259 24121 ts_manager.cc:194] Registered new tserver with Master: a6bd866a574f403f919379866931091d (127.1.126.195:35855)
I20260807 02:20:10.607825 24121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:39919
I20260807 02:20:10.607999 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.599527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40184 (local address 127.1.126.254:42303)
0807 02:20:10.599767 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.599772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.599965 (+ 193us) server_negotiation.cc:407] Connection header received
0807 02:20:10.600104 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.600107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.600144 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.600210 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:10.601441 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.601932 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.602824 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.603032 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.603135 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.604600 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:10.604609 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:10.604611 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:10.604633 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:10.606180 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.606615 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.606619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.606623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.606754 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.607064 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.607068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.607069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.607243 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:10.607453 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.607641 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.607758 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":61,"threads_started":1}
I20260807 02:20:10.609990 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:10.613549 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.610610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40196 (local address 127.1.126.254:42303)
0807 02:20:10.610762 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.610765 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.610928 (+ 163us) server_negotiation.cc:407] Connection header received
0807 02:20:10.611023 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.611025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.611124 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.611206 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:10.611342 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.611814 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.612599 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.612807 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.612885 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.613141 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:10.613261 (+ 120us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 02:20:10.613439 (+ 178us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40196: token expired
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 02:20:10.613615 24744 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40196: token expired
W20260807 02:20:10.613992 24023 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.126.254:42303)
I20260807 02:20:10.620857 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.614293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40208 (local address 127.1.126.254:42303)
0807 02:20:10.614400 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.614406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.614452 (+ 46us) server_negotiation.cc:407] Connection header received
0807 02:20:10.614556 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.614559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.614592 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.614688 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:10.615311 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.615761 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.616519 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.616756 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.616857 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.618105 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:10.618108 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:10.618111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:10.618134 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:10.619335 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.619734 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.619738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.619740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.619816 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:10.620088 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:10.620091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:10.620093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:10.620249 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:10.620379 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.620600 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.620722 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:20:10.623055 24121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:10.626035 24121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:10.633759 24282 tablet_service.cc:1467] Processing CreateTablet for tablet e93b383824c7416183e19555c15dbce9 (DEFAULT_TABLE table=test-table [id=e498743081d8451580b74e2d4d204c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:10.634397 24282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e93b383824c7416183e19555c15dbce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:10.636956 24223 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap starting.
I20260807 02:20:10.637286 24381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.632557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:37533 (local address 127.0.0.1:34948)
0807 02:20:10.632674 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.632690 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.632769 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.633611 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.633614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.633633 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:10.633720 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.633725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.635007 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.635010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.636027 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.636037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.636816 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.636819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.636935 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.637013 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.637095 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.637174 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 02:20:10.637938 24223 tablet_bootstrap.cc:654] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:10.638180 24751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.632813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:35855 (local address 127.0.0.1:34210)
0807 02:20:10.633277 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.633289 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.633372 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.634040 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.634046 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.634065 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:10.634168 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.634175 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.635831 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.635834 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.636853 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.636864 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.637783 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.637787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.637880 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.637912 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.637990 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.638054 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":110,"threads_started":1}
I20260807 02:20:10.638229 24752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.633064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34210 (local address 127.1.126.195:35855)
0807 02:20:10.633505 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.633515 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.633552 (+ 37us) server_negotiation.cc:407] Connection header received
0807 02:20:10.633624 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.633629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.633821 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.633984 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:10.634300 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.635704 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.637004 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.637660 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.637770 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.637920 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.638018 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.638100 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":139,"threads_started":1}
I20260807 02:20:10.639091 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.632720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34948 (local address 127.1.126.194:37533)
0807 02:20:10.633074 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.633084 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.633113 (+ 29us) server_negotiation.cc:407] Connection header received
0807 02:20:10.633212 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.633217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.633440 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.633608 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:10.633825 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.634864 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.636153 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.636674 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.636815 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.638884 (+ 2069us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.638924 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.638989 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":172,"threads_started":1}
I20260807 02:20:10.640164 24223 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: No bootstrap required, opened a new log
I20260807 02:20:10.640254 24223 ts_tablet_manager.cc:1397] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 02:20:10.640651 24223 raft_consensus.cc:348] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.640777 24223 raft_consensus.cc:374] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:10.640813 24223 raft_consensus.cc:729] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a45bc130d5477abfb0bd847a4de6db, State: Initialized, Role: FOLLOWER
I20260807 02:20:10.640954 24223 consensus_queue.cc:260] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.641216 24223 ts_tablet_manager.cc:1428] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 02:20:10.641149 24648 tablet_service.cc:1467] Processing CreateTablet for tablet e93b383824c7416183e19555c15dbce9 (DEFAULT_TABLE table=test-table [id=e498743081d8451580b74e2d4d204c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:10.641531 24471 tablet_service.cc:1467] Processing CreateTablet for tablet e93b383824c7416183e19555c15dbce9 (DEFAULT_TABLE table=test-table [id=e498743081d8451580b74e2d4d204c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:10.642238 24648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e93b383824c7416183e19555c15dbce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:10.642549 24471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e93b383824c7416183e19555c15dbce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:10.648756 24755 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Bootstrap starting.
I20260807 02:20:10.649175 24756 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Bootstrap starting.
I20260807 02:20:10.651230 24756 tablet_bootstrap.cc:654] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:10.651319 24755 tablet_bootstrap.cc:654] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:10.652077 24756 log.cc:824] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:10.652244 24755 log.cc:824] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:10.654006 24756 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: No bootstrap required, opened a new log
I20260807 02:20:10.654038 24755 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: No bootstrap required, opened a new log
I20260807 02:20:10.654212 24756 ts_tablet_manager.cc:1397] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 02:20:10.654225 24755 ts_tablet_manager.cc:1397] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:20:10.657379 24755 raft_consensus.cc:348] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.657595 24755 raft_consensus.cc:374] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:10.657446 24756 raft_consensus.cc:348] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.657675 24755 raft_consensus.cc:729] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bd866a574f403f919379866931091d, State: Initialized, Role: FOLLOWER
I20260807 02:20:10.657686 24756 raft_consensus.cc:374] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:10.657745 24756 raft_consensus.cc:729] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb2a6d3b8f04fdab15b68928c503b1b, State: Initialized, Role: FOLLOWER
I20260807 02:20:10.658129 24755 consensus_queue.cc:260] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.658187 24756 consensus_queue.cc:260] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.658826 24741 heartbeater.cc:503] Master 127.1.126.254:42303 was elected leader, sending a full tablet report...
I20260807 02:20:10.659118 24755 ts_tablet_manager.cc:1428] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 02:20:10.659132 24756 ts_tablet_manager.cc:1428] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 02:20:10.659467 24562 heartbeater.cc:503] Master 127.1.126.254:42303 was elected leader, sending a full tablet report...
W20260807 02:20:10.659940 24564 tablet.cc:2369] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 02:20:10.715668 24371 tablet.cc:2369] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:10.837904 24379 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:10.838135 24379 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.839349 24379 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
W20260807 02:20:10.841329 24742 tablet.cc:2369] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:10.843688 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.839708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:49157 (local address 127.1.126.194:37533)
0807 02:20:10.839839 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.839843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.839923 (+ 80us) server_negotiation.cc:407] Connection header received
0807 02:20:10.840117 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.840123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.840198 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.840291 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:10.840614 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.841434 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.842641 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.843114 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.843253 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.843306 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.843489 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.843553 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:20:10.843736 24752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.840100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:38491 (local address 127.1.126.195:35855)
0807 02:20:10.840228 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.840234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.840302 (+ 68us) server_negotiation.cc:407] Connection header received
0807 02:20:10.840474 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.840477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.840515 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.840604 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:10.840823 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.841533 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.842672 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.843172 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.843308 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.843358 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.843540 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.843610 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:20:10.843750 24764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.839560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:37533 (local address 127.1.126.193:49157)
0807 02:20:10.839819 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.839834 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.839956 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.840327 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.840330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.840371 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:10.840505 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.840510 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.841575 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.841580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.842511 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.842521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.843243 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.843247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.843332 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.843384 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.843474 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.843547 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":55,"spinlock_wait_cycles":768,"thread_start_us":109,"threads_started":1}
I20260807 02:20:10.843983 24765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.839964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:35855 (local address 127.1.126.193:38491)
0807 02:20:10.840220 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.840230 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:10.840361 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:10.840643 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:10.840646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:10.840663 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:10.840723 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.840727 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.841656 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.841660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.842525 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:10.842537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.843307 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.843311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:10.843399 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.843423 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 02:20:10.843515 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 02:20:10.843586 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260807 02:20:10.844554 24674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e93b383824c7416183e19555c15dbce9" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bd866a574f403f919379866931091d" is_pre_election: true
I20260807 02:20:10.844596 24500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e93b383824c7416183e19555c15dbce9" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" is_pre_election: true
I20260807 02:20:10.844859 24674 raft_consensus.cc:2454] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 0.
I20260807 02:20:10.844869 24500 raft_consensus.cc:2454] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 0.
I20260807 02:20:10.845340 24218 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db, 3fb2a6d3b8f04fdab15b68928c503b1b; no voters:
I20260807 02:20:10.845630 24379 raft_consensus.cc:2781] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:10.845710 24379 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:10.845741 24379 raft_consensus.cc:3037] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:10.846879 24379 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.847223 24379 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 election: Requested vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
I20260807 02:20:10.847617 24500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e93b383824c7416183e19555c15dbce9" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
I20260807 02:20:10.847743 24500 raft_consensus.cc:3037] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:10.847744 24674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e93b383824c7416183e19555c15dbce9" candidate_uuid: "39a45bc130d5477abfb0bd847a4de6db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bd866a574f403f919379866931091d"
I20260807 02:20:10.847913 24674 raft_consensus.cc:3037] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:10.848793 24500 raft_consensus.cc:2454] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 1.
I20260807 02:20:10.849130 24218 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db, 3fb2a6d3b8f04fdab15b68928c503b1b; no voters:
I20260807 02:20:10.849153 24674 raft_consensus.cc:2454] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a45bc130d5477abfb0bd847a4de6db in term 1.
I20260807 02:20:10.849329 24379 raft_consensus.cc:2781] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:10.849516 24379 raft_consensus.cc:686] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 LEADER]: Becoming Leader. State: Replica: 39a45bc130d5477abfb0bd847a4de6db, State: Running, Role: LEADER
I20260807 02:20:10.849785 24379 consensus_queue.cc:237] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:10.853174 24121 catalog_manager.cc:5495] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193). New cstate: current_term: 1 leader_uuid: "39a45bc130d5477abfb0bd847a4de6db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } health_report { overall_health: HEALTHY } } }
I20260807 02:20:10.878960 24770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.875452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.1.126.193:40281)
0807 02:20:10.875733 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:10.875740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:10.875751 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:20:10.875824 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:10.875826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:10.875875 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:10.875975 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:10.876180 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.876827 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.877578 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:10.877785 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:10.877900 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:10.878160 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:10.878549 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:10.878636 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:10.878800 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 02:20:10.878848 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":137,"threads_started":1}
I20260807 02:20:10.882570 24500 raft_consensus.cc:1261] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Refusing update from remote peer 39a45bc130d5477abfb0bd847a4de6db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:10.882572 24674 raft_consensus.cc:1261] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Refusing update from remote peer 39a45bc130d5477abfb0bd847a4de6db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:10.883258 24379 consensus_queue.cc:1035] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:10.883466 24767 consensus_queue.cc:1035] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:10.900449 24119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:10.900624 24119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:10.902804 24119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Sending DeleteTablet for 3 replicas of tablet e93b383824c7416183e19555c15dbce9
I20260807 02:20:10.903548 24648 tablet_service.cc:1514] Processing DeleteTablet for tablet e93b383824c7416183e19555c15dbce9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:10 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:34210
I20260807 02:20:10.903556 24471 tablet_service.cc:1514] Processing DeleteTablet for tablet e93b383824c7416183e19555c15dbce9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:10 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:34948
I20260807 02:20:10.903959 24282 tablet_service.cc:1514] Processing DeleteTablet for tablet e93b383824c7416183e19555c15dbce9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:10 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:45104
I20260807 02:20:10.904301 24789 tablet_replica.cc:330] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: stopping tablet replica
I20260807 02:20:10.904374 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 24167
I20260807 02:20:10.912781 24787 tablet_replica.cc:330] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: stopping tablet replica
I20260807 02:20:10.913151 24788 tablet_replica.cc:330] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: stopping tablet replica
I20260807 02:20:10.913213 24787 raft_consensus.cc:2229] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:10.913550 24788 raft_consensus.cc:2229] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:10.913582 24787 raft_consensus.cc:2258] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:10.913859 24788 raft_consensus.cc:2258] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:10.915148 24787 ts_tablet_manager.cc:1905] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:10.915426 24788 ts_tablet_manager.cc:1905] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:10.917433 24787 ts_tablet_manager.cc:1918] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:10.917546 24787 log.cc:1196] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/e93b383824c7416183e19555c15dbce9
I20260807 02:20:10.917898 24787 ts_tablet_manager.cc:1939] T e93b383824c7416183e19555c15dbce9 P 3fb2a6d3b8f04fdab15b68928c503b1b: Deleting consensus metadata
I20260807 02:20:10.918787 24788 ts_tablet_manager.cc:1918] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:10.918884 24788 log.cc:1196] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/e93b383824c7416183e19555c15dbce9
I20260807 02:20:10.919215 24788 ts_tablet_manager.cc:1939] T e93b383824c7416183e19555c15dbce9 P a6bd866a574f403f919379866931091d: Deleting consensus metadata
I20260807 02:20:10.919327 24100 catalog_manager.cc:4841] TS 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): tablet e93b383824c7416183e19555c15dbce9 (table test-table [id=e498743081d8451580b74e2d4d204c37]) successfully deleted
I20260807 02:20:10.920368 24100 catalog_manager.cc:4841] TS a6bd866a574f403f919379866931091d (127.1.126.195:35855): tablet e93b383824c7416183e19555c15dbce9 (table test-table [id=e498743081d8451580b74e2d4d204c37]) successfully deleted
W20260807 02:20:10.921545 24100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:40281 (error 108)
I20260807 02:20:10.922456 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 24378
I20260807 02:20:10.922590 24751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:10.922294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40281 (local address 127.0.0.1:45114)
0807 02:20:10.922422 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:10.922493 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 02:20:10.926278 24100 catalog_manager.cc:4584] TS 39a45bc130d5477abfb0bd847a4de6db (127.1.126.193:40281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e93b383824c7416183e19555c15dbce9: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40281: connect: Connection refused (error 111)
I20260807 02:20:10.932343 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 24567
I20260807 02:20:10.951110 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 24075
I20260807 02:20:30.960212 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42303
--webserver_interface=127.1.126.254
--webserver_port=45391
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:31.079195 24793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:31.079473 24793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:31.079521 24793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:31.083460 24793 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 02:20:31.083519 24793 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 02:20:31.083535 24793 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 02:20:31.083549 24793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:31.083567 24793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:31.083585 24793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:31.083601 24793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:31.083621 24793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:31.088902 24793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=45391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:31.089953 24793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:31.090973 24793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:31.099675 24800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.099682 24804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.099682 24801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:31.099891 24793 server_base.cc:1034] running on GCE node
I20260807 02:20:31.100589 24793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:31.101713 24793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:31.102933 24793 hybrid_clock.cc:648] HybridClock initialized: now 1786069231102910 us; error 33 us; skew 500 ppm
Aug 07 02:20:31 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069231, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:31.112154 24793 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:20:31.113178 24793 webserver.cc:460] Webserver started at http://127.1.126.254:45391/ using document root <none> and password file <none>
I20260807 02:20:31.113740 24793 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:31.113803 24793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:31.117764 24793 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:20:31.120057 24812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.121335 24793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:20:31.121443 24793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "971f5a54241944b08dbc1131d98dd2a0"
format_stamp: "Formatted at 2026-08-07 02:19:48 on dist-test-slave-39l8"
server_key: "a945895035e4428762ec51ec81dd23a5"
server_key_iv: "5d8f823c05081bdedae63ba55e50a626"
server_key_version: "encryptionkey@0"
I20260807 02:20:31.121978 24793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:31.147845 24793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:31.150681 24793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:31.150857 24793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:31.158262 24793 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:42303
I20260807 02:20:31.158573 24893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:42303 every 8 connection(s)
I20260807 02:20:31.159454 24793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:31.163928 24894 sys_catalog.cc:263] Verifying existing consensus state
I20260807 02:20:31.165619 24894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap starting.
I20260807 02:20:31.168889 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 24793
I20260807 02:20:31.169338 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:40281
--local_ip_for_outbound_sockets=127.1.126.193
--tserver_master_addrs=127.1.126.254:42303
--webserver_port=41187
--webserver_interface=127.1.126.193
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:20:31.183528 24894 log.cc:824] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:31.195218 24894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 02:20:31.195637 24894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: Bootstrap complete.
I20260807 02:20:31.199780 24894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:31.200192 24894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 971f5a54241944b08dbc1131d98dd2a0, State: Initialized, Role: FOLLOWER
I20260807 02:20:31.200685 24894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:31.200835 24894 raft_consensus.cc:388] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:31.200923 24894 raft_consensus.cc:482] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:31.201048 24894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 02:20:31.202975 24894 raft_consensus.cc:504] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:31.203330 24894 leader_election.cc:302] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 971f5a54241944b08dbc1131d98dd2a0; no voters:
I20260807 02:20:31.203657 24894 leader_election.cc:288] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 02:20:31.203799 24900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 02:20:31.204063 24900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [term 3 LEADER]: Becoming Leader. State: Replica: 971f5a54241944b08dbc1131d98dd2a0, State: Running, Role: LEADER
I20260807 02:20:31.204540 24900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } }
I20260807 02:20:31.204950 24894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:31.206022 24901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "971f5a54241944b08dbc1131d98dd2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } } }
I20260807 02:20:31.206146 24901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:31.206529 24905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 971f5a54241944b08dbc1131d98dd2a0. Latest consensus state: current_term: 3 leader_uuid: "971f5a54241944b08dbc1131d98dd2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "971f5a54241944b08dbc1131d98dd2a0" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 42303 } } }
I20260807 02:20:31.206667 24905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:31.210222 24931 catalog_manager.cc:1259] Loaded cluster ID: 2fce4c2d9a9d4b0abe4132870715cf74
I20260807 02:20:31.210283 24931 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: loading cluster ID for follower catalog manager: success
I20260807 02:20:31.212906 24931 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 971f5a54241944b08dbc1131d98dd2a0: acquiring CA information for follower catalog manager: success
F20260807 02:20:31.214135 24931 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f02941ce9ad google::LogMessage::Fail() at ??:0
@ 0x7f02941d188a google::LogMessage::SendToLog() at ??:0
@ 0x7f02941ce4de google::LogMessage::Flush() at ??:0
@ 0x7f02941cfa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0296e9218d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f029eb33989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f029eb10023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f029eb1054b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f029eb09652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f029eb089e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7f029eb4f541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f0296411512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0297a556db start_thread at ??:0
@ 0x7f0292ccc61f clone at ??:0
W20260807 02:20:31.309082 24897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:31.309312 24897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:31.309356 24897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:31.313342 24897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:31.313391 24897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:31.313464 24897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:31.318573 24897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:40281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=41187
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:31.319561 24897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:31.320551 24897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:31.330092 24955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.330085 24960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:31.330276 24897 server_base.cc:1034] running on GCE node
W20260807 02:20:31.330122 24956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:31.330958 24897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:31.331773 24897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:31.332985 24897 hybrid_clock.cc:648] HybridClock initialized: now 1786069231332948 us; error 42 us; skew 500 ppm
Aug 07 02:20:31 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069231, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:31.336293 24897 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:20:31.337157 24897 webserver.cc:460] Webserver started at http://127.1.126.193:41187/ using document root <none> and password file <none>
I20260807 02:20:31.337728 24897 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:31.337821 24897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:31.341696 24897 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:31.343982 24967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.345283 24897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:20:31.345418 24897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "39a45bc130d5477abfb0bd847a4de6db"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "fc3cb7e8669f2e70ae61a5d4e035e294"
server_key_iv: "5a969b2e5d045a2f81563a697612e138"
server_key_version: "encryptionkey@0"
I20260807 02:20:31.345942 24897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:31.379112 24897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:31.382514 24897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:31.382789 24897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:31.383422 24897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:31.384577 24975 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 02:20:31.390125 24897 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 02:20:31.390208 24897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 02:20:31.390304 24897 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 02:20:31.392022 24897 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 02:20:31.392091 24897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 02:20:31.392378 24975 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap starting.
I20260807 02:20:31.403215 24897 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:40281
I20260807 02:20:31.403439 25114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:40281 every 8 connection(s)
I20260807 02:20:31.404208 24897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:31.407532 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 24897
I20260807 02:20:31.408039 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:37533
--local_ip_for_outbound_sockets=127.1.126.194
--tserver_master_addrs=127.1.126.254:42303
--webserver_port=40285
--webserver_interface=127.1.126.194
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:20:31.418799 24975 log.cc:824] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:31.426313 24975 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260807 02:20:31.426556 25117 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:20:31.406251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:45745)
0807 02:20:31.406805 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.406860 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:31.408037 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:31.425615 (+ 17578us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":130,"threads_started":1}
I20260807 02:20:31.426745 24975 tablet_bootstrap.cc:492] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Bootstrap complete.
W20260807 02:20:31.427148 25115 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:42303 (0 consecutive failures): Network error: Failed to ping master at 127.1.126.254:42303: Client connection negotiation failed: client connection to 127.1.126.254:42303: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 02:20:31.427917 25117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.427626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:37867)
0807 02:20:31.427779 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.427852 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 02:20:31.428103 24975 ts_tablet_manager.cc:1397] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Time spent bootstrapping tablet: real 0.036s user 0.018s sys 0.012s
I20260807 02:20:31.428632 25117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.428403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:58031)
0807 02:20:31.428521 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.428570 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 02:20:31.428850 25115 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 02:20:31.430595 24975 raft_consensus.cc:348] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:31.431066 24975 raft_consensus.cc:729] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a45bc130d5477abfb0bd847a4de6db, State: Initialized, Role: FOLLOWER
I20260807 02:20:31.431530 24975 consensus_queue.cc:260] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:31.432566 24975 ts_tablet_manager.cc:1428] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 02:20:31.432646 25117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.432369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:34583)
0807 02:20:31.432486 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.432545 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 02:20:31.433314 25117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.433103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:39307)
0807 02:20:31.433212 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.433255 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 02:20:31.526906 25118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:31.527141 25118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:31.527230 25118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:31.531200 25118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:31.531255 25118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:31.531374 25118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:31.536553 25118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:37533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=40285
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:31.537546 25118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:31.538544 25118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:31.548480 25130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.548480 25128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.548617 25127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:31.548799 25118 server_base.cc:1034] running on GCE node
I20260807 02:20:31.549216 25118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:31.549880 25118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:31.551064 25118 hybrid_clock.cc:648] HybridClock initialized: now 1786069231551032 us; error 44 us; skew 500 ppm
Aug 07 02:20:31 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069231, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:31.553887 25118 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:20:31.554832 25118 webserver.cc:460] Webserver started at http://127.1.126.194:40285/ using document root <none> and password file <none>
I20260807 02:20:31.555409 25118 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:31.555501 25118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:31.559293 25118 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 02:20:31.561406 25137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.562600 25118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:31.562778 25118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "3fb2a6d3b8f04fdab15b68928c503b1b"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "072d457a243411c0041c035eed822be8"
server_key_iv: "d983e48eed2cb2448fcf181d237d23c1"
server_key_version: "encryptionkey@0"
I20260807 02:20:31.563329 25118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:31.588312 25118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:31.591701 25118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:31.591905 25118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:31.592554 25118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:31.593410 25118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:31.593479 25118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.593552 25118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:31.593603 25118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.602890 25118 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:37533
I20260807 02:20:31.602921 25285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:37533 every 8 connection(s)
I20260807 02:20:31.603960 25118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:31.606869 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 25118
I20260807 02:20:31.607363 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:35855
--local_ip_for_outbound_sockets=127.1.126.195
--tserver_master_addrs=127.1.126.254:42303
--webserver_port=45327
--webserver_interface=127.1.126.195
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:20:31.608018 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.606108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:43241)
0807 02:20:31.606931 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.607075 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":104,"threads_started":1}
W20260807 02:20:31.608553 25286 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:42303 (0 consecutive failures): Network error: Failed to ping master at 127.1.126.254:42303: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
I20260807 02:20:31.609268 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.608955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:43827)
0807 02:20:31.609107 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.609185 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 02:20:31.609969 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.609782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:56797)
0807 02:20:31.609881 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.609925 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 02:20:31.610204 25286 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 02:20:31.726967 25289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:31.727213 25289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:31.727289 25289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:31.731591 25289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:31.731653 25289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:31.731755 25289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:31.736972 25289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:35855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=45327
--tserver_master_addrs=127.1.126.254:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:31.737946 25289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:31.739022 25289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:31.748468 25295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.748481 25298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:31.748590 25294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:31.748788 25289 server_base.cc:1034] running on GCE node
I20260807 02:20:31.749230 25289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:31.749830 25289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:31.751012 25289 hybrid_clock.cc:648] HybridClock initialized: now 1786069231750968 us; error 55 us; skew 500 ppm
Aug 07 02:20:31 dist-test-slave-39l8 krb5kdc[23325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069231, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:31.753774 25289 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:20:31.754659 25289 webserver.cc:460] Webserver started at http://127.1.126.195:45327/ using document root <none> and password file <none>
I20260807 02:20:31.755244 25289 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:31.755334 25289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:31.758997 25289 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 02:20:31.761053 25309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.762243 25289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:31.762372 25289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a6bd866a574f403f919379866931091d"
format_stamp: "Formatted at 2026-08-07 02:19:49 on dist-test-slave-39l8"
server_key: "f1714c9cea99358fa78a9a94cca4c72c"
server_key_iv: "717b41cb1ffca3032999291a7011354f"
server_key_version: "encryptionkey@0"
I20260807 02:20:31.762935 25289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:31.782392 25289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:31.785626 25289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:31.785828 25289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:31.786466 25289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:31.787314 25289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:31.787385 25289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.787453 25289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:31.787498 25289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:31.796650 25289 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:35855
I20260807 02:20:31.796679 25470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:35855 every 8 connection(s)
I20260807 02:20:31.797617 25289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:31.801179 25476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.799730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:53459)
0807 02:20:31.800407 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.800514 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":109,"threads_started":1}
W20260807 02:20:31.801712 25471 heartbeater.cc:644] Failed to heartbeat to 127.1.126.254:42303 (0 consecutive failures): Network error: Failed to ping master at 127.1.126.254:42303: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
I20260807 02:20:31.802237 25476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.802033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:56757)
0807 02:20:31.802137 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.802181 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 02:20:31.802886 25476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:31.802662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:46401)
0807 02:20:31.802782 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:31.802829 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 02:20:31.803056 25471 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 02:20:31.804939 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 25289
I20260807 02:20:32.434800 25479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:32.434199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:45143)
0807 02:20:32.434568 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:32.434638 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":123,"threads_started":1}
I20260807 02:20:32.611325 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:32.610841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:44269)
0807 02:20:32.611166 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:32.611217 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":120,"threads_started":1}
I20260807 02:20:32.804021 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:32.803615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:50819)
0807 02:20:32.803853 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:32.803909 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260807 02:20:33.247831 25482 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:33.248096 25482 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:33.249259 25482 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
Aug 07 02:20:33 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069231, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.195@KRBTEST.COM
Aug 07 02:20:33 dist-test-slave-39l8 krb5kdc[23325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069231, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.194@KRBTEST.COM
I20260807 02:20:33.263273 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.249499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:37533 (local address 127.1.126.193:54913)
0807 02:20:33.249752 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:33.249770 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:33.250071 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:33.251746 (+ 1675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:33.251755 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:33.252302 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:33.252710 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:33.252724 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.253997 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.254003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:33.254970 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:33.254981 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.255731 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.255734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:33.255991 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:33.256712 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:33.256724 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:33.258461 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:33.260623 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:33.260625 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:33.260627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:33.260926 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:33.261292 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:33.261296 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:33.261299 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:33.261443 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:33.262147 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:33.262154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:33.262444 (+ 290us) client_negotiation.cc:769] Sending connection context
0807 02:20:33.262647 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 02:20:33.263069 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":113,"spinlock_wait_cycles":16768,"thread_start_us":79,"threads_started":1}
I20260807 02:20:33.263311 25489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.250189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:40959 (local address 127.1.126.195:35855)
0807 02:20:33.250518 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:33.250539 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:33.250568 (+ 29us) server_negotiation.cc:407] Connection header received
0807 02:20:33.251242 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:33.251248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:33.251591 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:33.251897 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:33.252890 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.253853 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.255154 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.255597 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.255784 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:33.258339 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:33.258348 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:33.258368 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:33.258404 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:33.260407 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:33.261066 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:33.261078 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:33.261083 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:33.261199 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:33.261569 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:33.261573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:33.261576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:33.262229 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:33.262375 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:33.262827 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 02:20:33.263121 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":76,"threads_started":1}
I20260807 02:20:33.263334 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.249685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:54913 (local address 127.1.126.194:37533)
0807 02:20:33.250044 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:33.250079 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:33.250187 (+ 108us) server_negotiation.cc:407] Connection header received
0807 02:20:33.250989 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:33.250996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:33.251368 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:33.251625 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:33.252894 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.253840 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.255115 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.255600 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.255774 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:33.258661 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:33.258668 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:33.258680 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:33.258761 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:33.260502 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:33.261043 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:33.261049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:33.261054 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:33.261187 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:33.261545 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:33.261551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:33.261555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:33.262005 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:33.262119 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:33.262824 (+ 705us) server_negotiation.cc:299] Negotiation successful
0807 02:20:33.263136 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":80,"threads_started":1}
I20260807 02:20:33.263322 25488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.249885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:35855 (local address 127.1.126.193:40959)
0807 02:20:33.250272 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:33.250287 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:33.250414 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:33.251879 (+ 1465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:33.251882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:33.252267 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:33.252709 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:33.252723 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.254011 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.254014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:33.254973 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:33.254984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:33.255750 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:33.255754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:33.255964 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:33.256537 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:33.256554 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:33.258073 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:33.260535 (+ 2462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:33.260544 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:33.260560 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:33.260930 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:33.261328 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:33.261330 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:33.261332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:33.261448 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:33.262349 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:33.262351 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:33.262438 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 02:20:33.262647 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 02:20:33.263165 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":346,"spinlock_wait_cycles":7040,"thread_start_us":59,"threads_started":1}
W20260807 02:20:33.266045 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6bd866a574f403f919379866931091d (127.1.126.195:35855): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
W20260807 02:20:33.266772 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
I20260807 02:20:33.266893 24969 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db; no voters: 3fb2a6d3b8f04fdab15b68928c503b1b, a6bd866a574f403f919379866931091d
I20260807 02:20:33.267203 25482 raft_consensus.cc:2726] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:20:33.435802 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.435519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:60019)
0807 02:20:33.435656 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:33.435716 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 02:20:33.612505 25491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.612066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:46053)
0807 02:20:33.612342 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:33.612398 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":79,"threads_started":1}
I20260807 02:20:33.805186 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:33.804796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:49417)
0807 02:20:33.805029 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:33.805083 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260807 02:20:34.437063 25496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:34.436598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:33657)
0807 02:20:34.436897 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:34.436950 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":74,"threads_started":1}
I20260807 02:20:34.613638 25498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:34.613222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:54765)
0807 02:20:34.613479 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:34.613534 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":94,"threads_started":1}
I20260807 02:20:34.806571 25499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:34.806046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:53859)
0807 02:20:34.806388 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:34.806451 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":101,"threads_started":1}
I20260807 02:20:35.438555 25500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:35.438104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:45917)
0807 02:20:35.438382 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:35.438451 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":86,"threads_started":1}
I20260807 02:20:35.506184 25501 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:35.506371 25501 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:35.507021 25501 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
W20260807 02:20:35.507897 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
W20260807 02:20:35.508077 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6bd866a574f403f919379866931091d (127.1.126.195:35855): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
I20260807 02:20:35.508157 24969 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db; no voters: 3fb2a6d3b8f04fdab15b68928c503b1b, a6bd866a574f403f919379866931091d
I20260807 02:20:35.508298 25501 raft_consensus.cc:2726] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:20:35.615048 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:35.614474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:34287)
0807 02:20:35.614863 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:35.614928 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":100,"threads_started":1}
I20260807 02:20:35.807737 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:35.807334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:56083)
0807 02:20:35.807581 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:35.807637 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
I20260807 02:20:36.440035 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:36.439580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:44927)
0807 02:20:36.439863 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:36.439924 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":78,"threads_started":1}
I20260807 02:20:36.616254 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:36.615832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:44611)
0807 02:20:36.616090 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:36.616156 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":78,"threads_started":1}
I20260807 02:20:36.808902 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:36.808489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:40743)
0807 02:20:36.808747 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:36.808806 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":74,"threads_started":1}
I20260807 02:20:37.441282 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:37.440811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:39955)
0807 02:20:37.441114 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:37.441177 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":75,"threads_started":1}
I20260807 02:20:37.617568 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:37.616987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:58759)
0807 02:20:37.617261 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:37.617316 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":75,"threads_started":1}
I20260807 02:20:37.810261 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:37.809788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:52217)
0807 02:20:37.810096 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:37.810160 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":95,"threads_started":1}
I20260807 02:20:38.442790 25513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:38.442182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:46445)
0807 02:20:38.442535 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:38.442610 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":111,"threads_started":1}
I20260807 02:20:38.619107 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:38.618476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:53101)
0807 02:20:38.618908 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:38.618983 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":132,"threads_started":1}
I20260807 02:20:38.714212 25515 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:38.714417 25515 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:38.714982 25515 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
W20260807 02:20:38.715987 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
W20260807 02:20:38.716100 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6bd866a574f403f919379866931091d (127.1.126.195:35855): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
I20260807 02:20:38.716166 24969 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db; no voters: 3fb2a6d3b8f04fdab15b68928c503b1b, a6bd866a574f403f919379866931091d
I20260807 02:20:38.716369 25515 raft_consensus.cc:2726] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:20:38.811594 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:38.811130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:50761)
0807 02:20:38.811444 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:38.811501 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":93,"threads_started":1}
I20260807 02:20:39.443988 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:39.443559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:58083)
0807 02:20:39.443834 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:39.443889 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":105,"threads_started":1}
I20260807 02:20:39.620362 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:39.619917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:59509)
0807 02:20:39.620189 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:39.620249 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":80,"threads_started":1}
I20260807 02:20:39.812920 25519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:39.812463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:51489)
0807 02:20:39.812752 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:39.812817 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
I20260807 02:20:40.445308 25520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:40.444884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:42799)
0807 02:20:40.445154 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:40.445210 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":78,"threads_started":1}
I20260807 02:20:40.621647 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:40.621218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:55207)
0807 02:20:40.621481 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:40.621543 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":75,"threads_started":1}
I20260807 02:20:40.814265 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:40.813828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:37699)
0807 02:20:40.814096 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:40.814164 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":78,"threads_started":1}
I20260807 02:20:41.446676 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:41.446256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:50643)
0807 02:20:41.446513 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:41.446571 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260807 02:20:41.480189 25527 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:41.480335 25527 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:41.480814 25527 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
W20260807 02:20:41.481709 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6bd866a574f403f919379866931091d (127.1.126.195:35855): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
W20260807 02:20:41.481824 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
I20260807 02:20:41.481859 24969 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db; no voters: 3fb2a6d3b8f04fdab15b68928c503b1b, a6bd866a574f403f919379866931091d
I20260807 02:20:41.482012 25527 raft_consensus.cc:2726] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:20:41.622917 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:41.622433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:52627)
0807 02:20:41.622761 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:41.622820 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":78,"threads_started":1}
I20260807 02:20:41.815590 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:41.815147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:42801)
0807 02:20:41.815425 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:41.815490 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
I20260807 02:20:42.447947 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:42.447535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:35459)
0807 02:20:42.447790 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:42.447848 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
I20260807 02:20:42.624312 25532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:42.623858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:52923)
0807 02:20:42.624146 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:42.624205 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":80,"threads_started":1}
I20260807 02:20:42.816715 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:42.816324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:44699)
0807 02:20:42.816567 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:42.816620 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":76,"threads_started":1}
I20260807 02:20:43.449294 25535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:43.448842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:56733)
0807 02:20:43.449118 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:43.449194 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":84,"threads_started":1}
I20260807 02:20:43.625618 25536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:43.625159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:40213)
0807 02:20:43.625463 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:43.625516 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":97,"threads_started":1}
I20260807 02:20:43.818032 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:43.817547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:32979)
0807 02:20:43.817865 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:43.817930 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":82,"threads_started":1}
I20260807 02:20:44.450557 25538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:44.450041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:41353)
0807 02:20:44.450351 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:44.450427 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":78,"threads_started":1}
I20260807 02:20:44.626971 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:44.626518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:36609)
0807 02:20:44.626815 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:44.626871 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":76,"threads_started":1}
I20260807 02:20:44.819360 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:44.818915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:53209)
0807 02:20:44.819205 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:44.819264 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":101,"threads_started":1}
I20260807 02:20:45.451663 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:45.451253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:35115)
0807 02:20:45.451509 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:45.451563 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":81,"threads_started":1}
I20260807 02:20:45.628206 25545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:45.627777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:34357)
0807 02:20:45.628049 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:45.628106 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":74,"threads_started":1}
I20260807 02:20:45.820560 25546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:45.820142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:47269)
0807 02:20:45.820408 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:45.820466 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":84,"threads_started":1}
I20260807 02:20:46.453265 25547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:46.452827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.193:49721)
0807 02:20:46.453100 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:46.453161 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":94,"threads_started":1}
I20260807 02:20:46.550120 25548 raft_consensus.cc:482] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:46.550258 25548 raft_consensus.cc:504] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fb2a6d3b8f04fdab15b68928c503b1b" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 37533 } } peers { permanent_uuid: "a6bd866a574f403f919379866931091d" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 35855 } } peers { permanent_uuid: "39a45bc130d5477abfb0bd847a4de6db" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40281 } }
I20260807 02:20:46.550643 25548 leader_election.cc:288] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533), a6bd866a574f403f919379866931091d (127.1.126.195:35855)
W20260807 02:20:46.551548 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6bd866a574f403f919379866931091d (127.1.126.195:35855): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
W20260807 02:20:46.551728 24969 leader_election.cc:341] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3fb2a6d3b8f04fdab15b68928c503b1b (127.1.126.194:37533): Not found: Tablet not found: e93b383824c7416183e19555c15dbce9
I20260807 02:20:46.551801 24969 leader_election.cc:302] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a45bc130d5477abfb0bd847a4de6db; no voters: 3fb2a6d3b8f04fdab15b68928c503b1b, a6bd866a574f403f919379866931091d
I20260807 02:20:46.551998 25548 raft_consensus.cc:2726] T e93b383824c7416183e19555c15dbce9 P 39a45bc130d5477abfb0bd847a4de6db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 02:20:46.629698 25551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:46.629219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.194:60683)
0807 02:20:46.629525 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:46.629595 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
I20260807 02:20:46.812938 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 24897
I20260807 02:20:46.822190 25552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:46.821641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:42303 (local address 127.1.126.195:34537)
0807 02:20:46.821961 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:46.822040 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.254:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":69,"threads_started":1}
I20260807 02:20:46.827605 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 25118
I20260807 02:20:46.836025 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 25289
2026-08-07T02:20:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59454 ms)
[----------] 30 tests from SecurityITest (243276 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:20:46 dist-test-slave-39l8 krb5kdc[25556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:20:46 dist-test-slave-39l8 krb5kdc[25556](info): set up 2 sockets
Aug 07 02:20:46 dist-test-slave-39l8 krb5kdc[25556](info): commencing operation
krb5kdc: starting...
W20260807 02:20:48.059258 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:20:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:20:48.185904 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36337
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:36337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:48.299705 25572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:48.299999 25572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:48.300101 25572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:48.304152 25572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:48.304239 25572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:48.304277 25572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:48.304333 25572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:48.304373 25572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:48.309814 25572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:36337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:36337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:48.311004 25572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:48.312080 25572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:48.321146 25579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:48.321156 25580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:48.321161 25572 server_base.cc:1034] running on GCE node
W20260807 02:20:48.321179 25583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:48.321985 25572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:48.323232 25572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:48.324422 25572 hybrid_clock.cc:648] HybridClock initialized: now 1786069248324398 us; error 34 us; skew 500 ppm
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:48.327381 25572 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:20:48.328284 25572 webserver.cc:460] Webserver started at http://127.1.126.254:43279/ using document root <none> and password file <none>
I20260807 02:20:48.328884 25572 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:48.328982 25572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:48.329233 25572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:48.331401 25572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "2b64ec2206f845deaae9ee228c324dfe"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "24915565390a5c5785f7d4962be53f98"
server_key_iv: "dcc878cb1e643ae52f9aacd2a6c85dd2"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.331990 25572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "2b64ec2206f845deaae9ee228c324dfe"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "24915565390a5c5785f7d4962be53f98"
server_key_iv: "dcc878cb1e643ae52f9aacd2a6c85dd2"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.335688 25572 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:20:48.338021 25592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.339301 25572 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:48.339440 25572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "2b64ec2206f845deaae9ee228c324dfe"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "24915565390a5c5785f7d4962be53f98"
server_key_iv: "dcc878cb1e643ae52f9aacd2a6c85dd2"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.339550 25572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:48.355159 25572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:48.357925 25572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:48.358126 25572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:48.365694 25572 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:36337
I20260807 02:20:48.365774 25663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:36337 every 8 connection(s)
I20260807 02:20:48.366667 25572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:48.369479 25664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:48.372663 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 25572
I20260807 02:20:48.372800 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:48.373128 1531 external_mini_cluster.cc:1428] Setting key 0ebb7f4f1320767dafddfebc01cf15b2
I20260807 02:20:48.376192 25664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe: Bootstrap starting.
I20260807 02:20:48.379029 25664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:48.379868 25664 log.cc:824] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:48.381731 25664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe: No bootstrap required, opened a new log
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:48.385370 25664 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b64ec2206f845deaae9ee228c324dfe" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36337 } }
I20260807 02:20:48.385627 25664 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:48.385715 25664 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b64ec2206f845deaae9ee228c324dfe, State: Initialized, Role: FOLLOWER
I20260807 02:20:48.386236 25664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b64ec2206f845deaae9ee228c324dfe" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36337 } }
I20260807 02:20:48.386416 25664 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:48.386500 25664 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:48.386622 25664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:48.387737 25664 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b64ec2206f845deaae9ee228c324dfe" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36337 } }
I20260807 02:20:48.388118 25664 leader_election.cc:302] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b64ec2206f845deaae9ee228c324dfe; no voters:
I20260807 02:20:48.388492 25664 leader_election.cc:288] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:48.388599 25672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:48.388818 25672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [term 1 LEADER]: Becoming Leader. State: Replica: 2b64ec2206f845deaae9ee228c324dfe, State: Running, Role: LEADER
I20260807 02:20:48.389142 25672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b64ec2206f845deaae9ee228c324dfe" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36337 } }
I20260807 02:20:48.389489 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:48.374583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50014 (local address 127.1.126.254:36337)
0807 02:20:48.375038 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:48.375063 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:48.375107 (+ 44us) server_negotiation.cc:407] Connection header received
0807 02:20:48.375913 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:48.375937 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:48.376363 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:48.376722 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:48.377374 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.378897 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.379800 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.380471 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.380654 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:48.383406 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:48.383411 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:48.383424 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:48.383452 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:48.385984 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:48.386615 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:48.386621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:48.386633 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:48.386826 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:48.387149 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:48.387151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:48.387152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:48.387537 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:48.387681 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:48.388063 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 02:20:48.388440 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":150,"threads_started":1}
I20260807 02:20:48.389822 25664 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:48.390375 25672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b64ec2206f845deaae9ee228c324dfe. Latest consensus state: current_term: 1 leader_uuid: "2b64ec2206f845deaae9ee228c324dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b64ec2206f845deaae9ee228c324dfe" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36337 } } }
I20260807 02:20:48.390503 25672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:48.391000 25673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b64ec2206f845deaae9ee228c324dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b64ec2206f845deaae9ee228c324dfe" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 36337 } } }
I20260807 02:20:48.391165 25673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:48.392216 25679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:48.395797 25679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:48.401559 25679 catalog_manager.cc:1347] Generated new cluster ID: a779a111f1b149a1b7f0f600efec782c
I20260807 02:20:48.401638 25679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:48.409761 25679 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:48.411047 25679 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:48.420885 25679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe: Generated new TSK 0
I20260807 02:20:48.421664 25679 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:20:48.460108 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36337
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:48.575503 25700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:48.575793 25700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:48.575870 25700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:48.579905 25700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:48.579954 25700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:48.580011 25700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:48.584942 25700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:48.585880 25700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:48.586999 25700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:48.597031 25706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:48.597065 25709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:48.597115 25700 server_base.cc:1034] running on GCE node
W20260807 02:20:48.597065 25707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:48.597764 25700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:48.598385 25700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:48.599573 25700 hybrid_clock.cc:648] HybridClock initialized: now 1786069248599532 us; error 53 us; skew 500 ppm
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:48.602315 25700 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:20:48.603220 25700 webserver.cc:460] Webserver started at http://127.1.126.193:42583/ using document root <none> and password file <none>
I20260807 02:20:48.603796 25700 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:48.603904 25700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:48.604146 25700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:48.606221 25700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "5aa911029ad641d68646daf0f8a614a5"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "81df515dbd6a5d38aa61bcc3cd43dc6d"
server_key_iv: "c3a2da5555fb4cc7e6fe384cba7a3921"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.606837 25700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "5aa911029ad641d68646daf0f8a614a5"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "81df515dbd6a5d38aa61bcc3cd43dc6d"
server_key_iv: "c3a2da5555fb4cc7e6fe384cba7a3921"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.610637 25700 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 02:20:48.612986 25720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.614138 25700 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:48.614310 25700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "5aa911029ad641d68646daf0f8a614a5"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "81df515dbd6a5d38aa61bcc3cd43dc6d"
server_key_iv: "c3a2da5555fb4cc7e6fe384cba7a3921"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.614430 25700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:48.627064 25700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:48.629849 25700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:48.630056 25700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:48.630633 25700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:48.631491 25700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:48.631564 25700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.631631 25700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:48.631681 25700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.640727 25700 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:35013
I20260807 02:20:48.640753 25892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:35013 every 8 connection(s)
I20260807 02:20:48.641583 25700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:48.647239 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 25700
I20260807 02:20:48.647375 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:20:48.647671 1531 external_mini_cluster.cc:1428] Setting key abf57b7797407712804b96e9e769f647
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:48.655885 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:48.643466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:59521 (local address 127.1.126.254:36337)
0807 02:20:48.643609 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:48.643613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:48.644499 (+ 886us) server_negotiation.cc:407] Connection header received
0807 02:20:48.645857 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:48.645861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:48.645920 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:48.646029 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:48.647232 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.647898 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.649032 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.649266 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.649379 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:48.651814 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:48.651817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:48.651819 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:48.651842 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:48.653309 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:48.653976 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:48.653980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:48.653981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:48.654077 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:48.654559 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:48.654562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:48.654564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:48.654842 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:48.654936 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:48.655640 (+ 704us) server_negotiation.cc:299] Negotiation successful
0807 02:20:48.655756 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:20:48.657085 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:48.643921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36337 (local address 127.1.126.193:59521)
0807 02:20:48.644347 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:48.644388 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:48.645638 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:48.646207 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:48.646214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:48.646553 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:48.647078 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:48.647091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.648032 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.648036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:48.648889 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:48.648899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.649420 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.649424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:48.649588 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:48.650190 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:48.650206 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:48.651641 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:48.653435 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:48.653444 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:48.653460 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:48.653841 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:48.654198 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:48.654204 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:48.654209 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:48.654399 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:48.654966 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:48.654973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:48.655342 (+ 369us) client_negotiation.cc:769] Sending connection context
0807 02:20:48.655583 (+ 241us) client_negotiation.cc:240] Negotiation successful
0807 02:20:48.655961 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":111,"threads_started":1}
I20260807 02:20:48.658473 25893 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36337
I20260807 02:20:48.658761 25893 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:20:48.659360 25893 heartbeater.cc:511] Master 127.1.126.254:36337 requested a full tablet report, sending...
I20260807 02:20:48.660981 25616 ts_manager.cc:194] Registered new tserver with Master: 5aa911029ad641d68646daf0f8a614a5 (127.1.126.193:35013)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:20:48.662388 25616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:59521
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:20:48.679127 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36337
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:48.791154 25898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:48.791409 25898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:48.791450 25898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:48.795547 25898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:48.795603 25898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:48.795661 25898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:48.800721 25898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:48.801687 25898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:48.802706 25898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:48.812700 25908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:48.812711 25904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:48.812712 25906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:48.813053 25898 server_base.cc:1034] running on GCE node
I20260807 02:20:48.813515 25898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:48.814122 25898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:48.815313 25898 hybrid_clock.cc:648] HybridClock initialized: now 1786069248815290 us; error 27 us; skew 500 ppm
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:48.818050 25898 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:20:48.819037 25898 webserver.cc:460] Webserver started at http://127.1.126.194:37003/ using document root <none> and password file <none>
I20260807 02:20:48.819612 25898 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:48.819674 25898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:48.819927 25898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:48.821944 25898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "6ee3b311e5404a47a7d7f1091ec43c61"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "caca866b0f0f6c2ba04400b7192ceef8"
server_key_iv: "9cfa10ca99b8781af353dd46b110ea2f"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.822510 25898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "6ee3b311e5404a47a7d7f1091ec43c61"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "caca866b0f0f6c2ba04400b7192ceef8"
server_key_iv: "9cfa10ca99b8781af353dd46b110ea2f"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.826153 25898 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 02:20:48.828537 25917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.829674 25898 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:48.829810 25898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "6ee3b311e5404a47a7d7f1091ec43c61"
format_stamp: "Formatted at 2026-08-07 02:20:48 on dist-test-slave-39l8"
server_key: "caca866b0f0f6c2ba04400b7192ceef8"
server_key_iv: "9cfa10ca99b8781af353dd46b110ea2f"
server_key_version: "encryptionkey@0"
I20260807 02:20:48.829918 25898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:48.843853 25898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:48.847065 25898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:48.847289 25898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:48.847927 25898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:48.848793 25898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:48.848865 25898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.848939 25898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:48.848991 25898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:48.858222 25898 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:46033
I20260807 02:20:48.858246 26067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:46033 every 8 connection(s)
I20260807 02:20:48.859225 25898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:48.866179 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 25898
I20260807 02:20:48.866317 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:20:48.866626 1531 external_mini_cluster.cc:1428] Setting key e0e0ac41252546018a6e2a9d3306c4d2
Aug 07 02:20:48 dist-test-slave-39l8 krb5kdc[25556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069248, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:48.873939 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:48.861175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:49189 (local address 127.1.126.254:36337)
0807 02:20:48.861322 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:48.861325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:48.862185 (+ 860us) server_negotiation.cc:407] Connection header received
0807 02:20:48.863602 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:48.863605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:48.863666 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:48.863769 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:48.864944 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.865485 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.866846 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.867072 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.867195 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:48.869900 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:48.869904 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:48.869906 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:48.869929 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:48.871688 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:48.872209 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:48.872216 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:48.872220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:48.872316 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:48.872654 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:48.872661 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:48.872665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:48.872926 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:48.873035 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:48.873517 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 02:20:48.873677 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:20:48.874610 26070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:48.861529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36337 (local address 127.1.126.194:49189)
0807 02:20:48.862006 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:48.862052 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:48.863374 (+ 1322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:48.863943 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:48.863950 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:48.864304 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:48.864796 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:48.864810 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.865615 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.865624 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:48.866628 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:48.866638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:48.867231 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:48.867235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:48.867453 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:48.868163 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:48.868187 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:48.869730 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:48.871814 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:48.871819 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:48.871831 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:48.872104 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:48.872414 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:48.872417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:48.872418 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:48.872559 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:48.873030 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:48.873035 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:48.873270 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 02:20:48.873428 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 02:20:48.873696 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":110,"threads_started":1}
I20260807 02:20:48.875945 26068 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36337
I20260807 02:20:48.876199 26068 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:48.876721 26068 heartbeater.cc:511] Master 127.1.126.254:36337 requested a full tablet report, sending...
I20260807 02:20:48.877830 25616 ts_manager.cc:194] Registered new tserver with Master: 6ee3b311e5404a47a7d7f1091ec43c61 (127.1.126.194:46033)
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:20:48.878489 25616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:49189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:20:48.896996 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36337
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:40827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:49.010674 26074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:49.011005 26074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:49.011102 26074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:49.015185 26074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:49.015254 26074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:49.015336 26074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:49.020537 26074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:40827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:36337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:49.021548 26074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:49.022549 26074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:49.032173 26080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:49.032157 26082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.032203 26074 server_base.cc:1034] running on GCE node
W20260807 02:20:49.032157 26079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.032776 26074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:49.033442 26074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:49.034632 26074 hybrid_clock.cc:648] HybridClock initialized: now 1786069249034596 us; error 54 us; skew 500 ppm
Aug 07 02:20:49 dist-test-slave-39l8 krb5kdc[25556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069249, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:49.037359 26074 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:20:49.038137 26074 webserver.cc:460] Webserver started at http://127.1.126.195:35931/ using document root <none> and password file <none>
I20260807 02:20:49.038635 26074 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:49.038746 26074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:49.038959 26074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:49.040833 26074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "a158c15bb72b4540b8e37c75c94c379b"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "9f3dedcec46f33aeeafaf43b13d86f9a"
server_key_iv: "106c1ae0c47607a7e9a19baff96ed7be"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.041324 26074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "a158c15bb72b4540b8e37c75c94c379b"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "9f3dedcec46f33aeeafaf43b13d86f9a"
server_key_iv: "106c1ae0c47607a7e9a19baff96ed7be"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.045037 26074 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:20:49.047369 26090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.048555 26074 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:49.048693 26074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "a158c15bb72b4540b8e37c75c94c379b"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "9f3dedcec46f33aeeafaf43b13d86f9a"
server_key_iv: "106c1ae0c47607a7e9a19baff96ed7be"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.048794 26074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:49.063079 26074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:49.065692 26074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:49.065881 26074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:49.066421 26074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:49.067256 26074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:49.067302 26074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.067368 26074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:49.067411 26074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.076359 26074 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:39007
I20260807 02:20:49.076382 26262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:39007 every 8 connection(s)
I20260807 02:20:49.077193 26074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:49.083797 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 26074
I20260807 02:20:49.083958 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:20:49.084309 1531 external_mini_cluster.cc:1428] Setting key b517c7e4ee451984c0d0de1139f245b0
Aug 07 02:20:49 dist-test-slave-39l8 krb5kdc[25556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069249, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:49.090947 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.079004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:57107 (local address 127.1.126.254:36337)
0807 02:20:49.079145 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.079149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.079951 (+ 802us) server_negotiation.cc:407] Connection header received
0807 02:20:49.081151 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.081153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.081206 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.081280 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:49.082370 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.082986 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.084235 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.084554 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.084678 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.087574 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:49.087577 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:49.087579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:49.087604 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:49.089101 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:49.089549 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:49.089552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:49.089553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:49.089625 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:49.089911 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:49.089913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:49.089914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:49.090078 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:49.090154 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.090664 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.090830 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:20:49.091756 26270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.079358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:36337 (local address 127.1.126.195:57107)
0807 02:20:49.079799 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.079839 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.080962 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.081440 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.081446 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.081795 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:49.082242 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.082255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.083101 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.083104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.084111 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.084123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.084723 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.084727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.084955 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.085659 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:49.085675 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:49.087423 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:49.089196 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:49.089201 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:49.089211 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:49.089466 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:49.089704 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:49.089706 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:49.089707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:49.089830 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:49.090189 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:49.090194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:49.090456 (+ 262us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.090609 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.090908 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":108,"threads_started":1}
I20260807 02:20:49.092871 26263 heartbeater.cc:347] Connected to a master server at 127.1.126.254:36337
I20260807 02:20:49.093070 26263 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:49.093493 26263 heartbeater.cc:511] Master 127.1.126.254:36337 requested a full tablet report, sending...
I20260807 02:20:49.094435 25616 ts_manager.cc:194] Registered new tserver with Master: a158c15bb72b4540b8e37c75c94c379b (127.1.126.195:39007)
I20260807 02:20:49.095036 25616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:57107
I20260807 02:20:49.098001 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:49.107111 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.099947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50028 (local address 127.1.126.254:36337)
0807 02:20:49.100074 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.100080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.100275 (+ 195us) server_negotiation.cc:407] Connection header received
0807 02:20:49.100410 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.100413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.100458 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.100540 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:49.101250 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.101746 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.102587 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.102865 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.102970 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.104243 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:49.104247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:49.104250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:49.104274 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:49.105384 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:49.105808 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:49.105812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:49.105814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:49.105897 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:49.106180 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:49.106186 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:49.106189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:49.106415 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:49.106555 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.106836 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.106948 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:20:49.110133 25616 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:49.113214 25616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:49.127511 26282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.121805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35013 (local address 127.0.0.1:34510)
0807 02:20:49.122412 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.122425 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.122516 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.123677 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.123682 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.123706 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:49.123806 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.123812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.124901 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.124906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.126030 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.126040 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.126990 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.126993 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.127098 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.127137 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.127240 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.127351 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":47,"thread_start_us":107,"threads_started":1}
I20260807 02:20:49.127836 26281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.121712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:46033 (local address 127.0.0.1:33784)
0807 02:20:49.122000 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.122043 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.122157 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.123348 (+ 1191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.123356 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.123383 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:49.123538 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.123548 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.124977 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.124981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.126151 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.126162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.127250 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.127253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.127339 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.127360 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.127425 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.127479 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260807 02:20:49.127936 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.122351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.1.126.194:46033)
0807 02:20:49.122845 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.122858 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.122881 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:20:49.122965 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.122970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.123166 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.123334 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:49.123665 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.124820 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.126298 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.127138 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.127249 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.127370 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.127455 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.127543 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":132,"threads_started":1}
I20260807 02:20:49.127977 26288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.122444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.1.126.193:35013)
0807 02:20:49.122891 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.122905 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.122923 (+ 18us) server_negotiation.cc:407] Connection header received
0807 02:20:49.122986 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.122990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.123165 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.123334 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:49.123899 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.124772 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.126189 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.126850 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.126978 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.127129 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.127722 (+ 593us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.127818 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":86,"threads_started":1}
I20260807 02:20:49.129019 26285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.122084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39007 (local address 127.0.0.1:60606)
0807 02:20:49.123642 (+ 1558us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.123658 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.123738 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.124162 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.124166 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.124186 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:49.124262 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.124268 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.125610 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.125613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.126775 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.126787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.127956 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.127962 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.128730 (+ 768us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.128756 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.128830 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.128896 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1472,"mutex_wait_us":24,"thread_start_us":78,"threads_started":1}
I20260807 02:20:49.129405 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.122573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.1.126.195:39007)
0807 02:20:49.123074 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.123098 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.123749 (+ 651us) server_negotiation.cc:407] Connection header received
0807 02:20:49.123829 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.123834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.124007 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.124152 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:49.124373 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.125441 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.126912 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.127686 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.127776 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.127891 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.129188 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.129279 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":208,"threads_started":1}
I20260807 02:20:49.130630 25988 tablet_service.cc:1467] Processing CreateTablet for tablet 262511c2ead849359a555767e9ceb91f (DEFAULT_TABLE table=test-table [id=bb3be0b7e4d74256a0c6d943bf6eff86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:49.130623 25787 tablet_service.cc:1467] Processing CreateTablet for tablet 262511c2ead849359a555767e9ceb91f (DEFAULT_TABLE table=test-table [id=bb3be0b7e4d74256a0c6d943bf6eff86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:49.131585 25988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262511c2ead849359a555767e9ceb91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:49.131585 25787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262511c2ead849359a555767e9ceb91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:49.135763 26167 tablet_service.cc:1467] Processing CreateTablet for tablet 262511c2ead849359a555767e9ceb91f (DEFAULT_TABLE table=test-table [id=bb3be0b7e4d74256a0c6d943bf6eff86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:49.136863 26167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 262511c2ead849359a555767e9ceb91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:49.138775 26293 tablet_bootstrap.cc:492] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Bootstrap starting.
I20260807 02:20:49.140121 26294 tablet_bootstrap.cc:492] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: Bootstrap starting.
I20260807 02:20:49.141531 26293 tablet_bootstrap.cc:654] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:49.142304 26294 tablet_bootstrap.cc:654] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:49.142452 26293 log.cc:824] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:49.143157 26295 tablet_bootstrap.cc:492] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Bootstrap starting.
I20260807 02:20:49.144028 26294 log.cc:824] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:49.145219 26295 tablet_bootstrap.cc:654] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:49.145871 26294 tablet_bootstrap.cc:492] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: No bootstrap required, opened a new log
I20260807 02:20:49.146080 26293 tablet_bootstrap.cc:492] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: No bootstrap required, opened a new log
I20260807 02:20:49.146083 26294 ts_tablet_manager.cc:1397] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:20:49.146272 26293 ts_tablet_manager.cc:1397] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 02:20:49.146379 26295 log.cc:824] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:49.148284 26295 tablet_bootstrap.cc:492] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: No bootstrap required, opened a new log
I20260807 02:20:49.148458 26295 ts_tablet_manager.cc:1397] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 02:20:49.149338 26294 raft_consensus.cc:348] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.149569 26294 raft_consensus.cc:374] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:49.149643 26294 raft_consensus.cc:729] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aa911029ad641d68646daf0f8a614a5, State: Initialized, Role: FOLLOWER
I20260807 02:20:49.150040 26293 raft_consensus.cc:348] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.150188 26294 consensus_queue.cc:260] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.150382 26293 raft_consensus.cc:374] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:49.150491 26293 raft_consensus.cc:729] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee3b311e5404a47a7d7f1091ec43c61, State: Initialized, Role: FOLLOWER
I20260807 02:20:49.150996 26293 consensus_queue.cc:260] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.151525 26294 ts_tablet_manager.cc:1428] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:20:49.151755 26068 heartbeater.cc:503] Master 127.1.126.254:36337 was elected leader, sending a full tablet report...
I20260807 02:20:49.152068 26293 ts_tablet_manager.cc:1428] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:20:49.152295 26295 raft_consensus.cc:348] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.152498 26295 raft_consensus.cc:374] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:49.152581 26295 raft_consensus.cc:729] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a158c15bb72b4540b8e37c75c94c379b, State: Initialized, Role: FOLLOWER
I20260807 02:20:49.153070 25893 heartbeater.cc:503] Master 127.1.126.254:36337 was elected leader, sending a full tablet report...
I20260807 02:20:49.153872 26295 consensus_queue.cc:260] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.154614 26295 ts_tablet_manager.cc:1428] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260807 02:20:49.154974 26263 heartbeater.cc:503] Master 127.1.126.254:36337 was elected leader, sending a full tablet report...
I20260807 02:20:49.213277 26302 raft_consensus.cc:482] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:49.213496 26302 raft_consensus.cc:504] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.214694 26302 leader_election.cc:288] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5aa911029ad641d68646daf0f8a614a5 (127.1.126.193:35013), a158c15bb72b4540b8e37c75c94c379b (127.1.126.195:39007)
I20260807 02:20:49.219544 26288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.215018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:47691 (local address 127.1.126.193:35013)
0807 02:20:49.215137 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.215144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.215159 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:20:49.215338 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.215344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.215400 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.215524 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:49.215836 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.216613 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.218270 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.218906 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.219032 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.219116 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.219346 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.219414 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:20:49.219544 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.215191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:50385 (local address 127.1.126.195:39007)
0807 02:20:49.215320 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.215324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.215457 (+ 133us) server_negotiation.cc:407] Connection header received
0807 02:20:49.215569 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.215572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.215621 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.215729 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:49.215987 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.216699 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.218360 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.218997 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.219099 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.219146 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.219345 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.219414 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:20:49.219609 26070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.214941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35013 (local address 127.1.126.194:47691)
0807 02:20:49.215072 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.215088 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.215203 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.215536 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.215541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.215566 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:49.215686 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.215691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.216735 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.216737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.218136 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.218149 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.219027 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.219030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.219181 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.219241 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.219313 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.219416 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":123}
I20260807 02:20:49.219626 26306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.214956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39007 (local address 127.1.126.194:50385)
0807 02:20:49.215364 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.215375 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.215454 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.215763 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.215768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.215789 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:49.215892 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.215896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.216792 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.216795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.218260 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.218271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.219093 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.219096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.219185 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.219230 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.219313 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.219411 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":93,"thread_start_us":128,"threads_started":1}
I20260807 02:20:49.220311 26197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "262511c2ead849359a555767e9ceb91f" candidate_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a158c15bb72b4540b8e37c75c94c379b" is_pre_election: true
I20260807 02:20:49.220312 25815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "262511c2ead849359a555767e9ceb91f" candidate_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aa911029ad641d68646daf0f8a614a5" is_pre_election: true
I20260807 02:20:49.220604 26197 raft_consensus.cc:2454] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee3b311e5404a47a7d7f1091ec43c61 in term 0.
I20260807 02:20:49.220636 25815 raft_consensus.cc:2454] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee3b311e5404a47a7d7f1091ec43c61 in term 0.
I20260807 02:20:49.221077 25920 leader_election.cc:302] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ee3b311e5404a47a7d7f1091ec43c61, a158c15bb72b4540b8e37c75c94c379b; no voters:
I20260807 02:20:49.221385 26302 raft_consensus.cc:2781] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:49.221470 26302 raft_consensus.cc:482] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:49.221513 26302 raft_consensus.cc:3037] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:49.222497 26302 raft_consensus.cc:504] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.222856 26302 leader_election.cc:288] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [CANDIDATE]: Term 1 election: Requested vote from peers 5aa911029ad641d68646daf0f8a614a5 (127.1.126.193:35013), a158c15bb72b4540b8e37c75c94c379b (127.1.126.195:39007)
I20260807 02:20:49.223183 25815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "262511c2ead849359a555767e9ceb91f" candidate_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aa911029ad641d68646daf0f8a614a5"
I20260807 02:20:49.223183 26197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "262511c2ead849359a555767e9ceb91f" candidate_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a158c15bb72b4540b8e37c75c94c379b"
I20260807 02:20:49.223300 25815 raft_consensus.cc:3037] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:49.223328 26197 raft_consensus.cc:3037] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:49.224563 26197 raft_consensus.cc:2454] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee3b311e5404a47a7d7f1091ec43c61 in term 1.
I20260807 02:20:49.224563 25815 raft_consensus.cc:2454] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee3b311e5404a47a7d7f1091ec43c61 in term 1.
I20260807 02:20:49.224877 25922 leader_election.cc:302] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5aa911029ad641d68646daf0f8a614a5, 6ee3b311e5404a47a7d7f1091ec43c61; no voters:
I20260807 02:20:49.225036 26302 raft_consensus.cc:2781] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:49.225271 26302 raft_consensus.cc:686] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 1 LEADER]: Becoming Leader. State: Replica: 6ee3b311e5404a47a7d7f1091ec43c61, State: Running, Role: LEADER
I20260807 02:20:49.225594 26302 consensus_queue.cc:237] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } }
I20260807 02:20:49.228569 25613 catalog_manager.cc:5495] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ee3b311e5404a47a7d7f1091ec43c61 (127.1.126.194). New cstate: current_term: 1 leader_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ee3b311e5404a47a7d7f1091ec43c61" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 } health_report { overall_health: UNKNOWN } } }
I20260807 02:20:49.250165 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.246706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.1.126.194:46033)
0807 02:20:49.246896 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.246900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.246914 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:20:49.247060 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.247063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.247119 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.247211 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:49.247427 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.247911 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.248857 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.249052 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.249126 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.249394 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:49.249799 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:49.249886 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.249946 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.249992 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 02:20:49.255985 25815 raft_consensus.cc:1261] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 1 FOLLOWER]: Refusing update from remote peer 6ee3b311e5404a47a7d7f1091ec43c61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:49.255985 26197 raft_consensus.cc:1261] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 1 FOLLOWER]: Refusing update from remote peer 6ee3b311e5404a47a7d7f1091ec43c61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:49.256738 26302 consensus_queue.cc:1035] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5aa911029ad641d68646daf0f8a614a5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:49.256970 26308 consensus_queue.cc:1035] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a158c15bb72b4540b8e37c75c94c379b" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:49.263763 26312 mvcc.cc:205] Tried to move back new op lower bound from 7315739644945256448 to 7315739644830412800. Current Snapshot: MvccSnapshot[applied={T|T < 7315739644945256448}]
I20260807 02:20:49.272285 25616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:49.272471 25616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:49.274940 25616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b64ec2206f845deaae9ee228c324dfe: Sending DeleteTablet for 3 replicas of tablet 262511c2ead849359a555767e9ceb91f
I20260807 02:20:49.275664 25787 tablet_service.cc:1514] Processing DeleteTablet for tablet 262511c2ead849359a555767e9ceb91f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:34510
I20260807 02:20:49.275663 25988 tablet_service.cc:1514] Processing DeleteTablet for tablet 262511c2ead849359a555767e9ceb91f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:33784
I20260807 02:20:49.275663 26167 tablet_service.cc:1514] Processing DeleteTablet for tablet 262511c2ead849359a555767e9ceb91f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:49 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:60606
I20260807 02:20:49.276154 26328 tablet_replica.cc:330] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5: stopping tablet replica
I20260807 02:20:49.276154 26326 tablet_replica.cc:330] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: stopping tablet replica
I20260807 02:20:49.276443 26329 tablet_replica.cc:330] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: stopping tablet replica
I20260807 02:20:49.276453 26326 raft_consensus.cc:2229] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:49.276453 26328 raft_consensus.cc:2229] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:49.276736 26328 raft_consensus.cc:2258] T 262511c2ead849359a555767e9ceb91f P 5aa911029ad641d68646daf0f8a614a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:49.276736 26326 raft_consensus.cc:2258] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:49.276813 26329 raft_consensus.cc:2229] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:20:49.276844 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 25700
I20260807 02:20:49.277235 26329 raft_consensus.cc:2258] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:49.285897 26326 ts_tablet_manager.cc:1905] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:49.288757 26329 ts_tablet_manager.cc:1905] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:49.288932 26326 ts_tablet_manager.cc:1918] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:49.289122 26326 log.cc:1196] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/262511c2ead849359a555767e9ceb91f
I20260807 02:20:49.289564 26326 ts_tablet_manager.cc:1939] T 262511c2ead849359a555767e9ceb91f P a158c15bb72b4540b8e37c75c94c379b: Deleting consensus metadata
I20260807 02:20:49.291121 25595 catalog_manager.cc:4841] TS a158c15bb72b4540b8e37c75c94c379b (127.1.126.195:39007): tablet 262511c2ead849359a555767e9ceb91f (table test-table [id=bb3be0b7e4d74256a0c6d943bf6eff86]) successfully deleted
I20260807 02:20:49.292436 26329 ts_tablet_manager.cc:1918] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:49.292542 26329 log.cc:1196] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/262511c2ead849359a555767e9ceb91f
I20260807 02:20:49.292917 26329 ts_tablet_manager.cc:1939] T 262511c2ead849359a555767e9ceb91f P 6ee3b311e5404a47a7d7f1091ec43c61: Deleting consensus metadata
I20260807 02:20:49.294132 25596 catalog_manager.cc:4841] TS 6ee3b311e5404a47a7d7f1091ec43c61 (127.1.126.194:46033): tablet 262511c2ead849359a555767e9ceb91f (table test-table [id=bb3be0b7e4d74256a0c6d943bf6eff86]) successfully deleted
W20260807 02:20:49.295231 25597 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:35013 (error 108)
I20260807 02:20:49.296144 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 25898
I20260807 02:20:49.296336 26285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.296009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35013 (local address 127.0.0.1:34522)
0807 02:20:49.296142 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.296231 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 02:20:49.302865 25597 catalog_manager.cc:4584] TS 5aa911029ad641d68646daf0f8a614a5 (127.1.126.193:35013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 262511c2ead849359a555767e9ceb91f: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35013: connect: Connection refused (error 111)
I20260807 02:20:49.308198 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 26074
I20260807 02:20:49.318035 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 25572
2026-08-07T02:20:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2486 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T02:20:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:49Z Disabled control of system clock
I20260807 02:20:49.357396 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:44721
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:37541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:44721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 02:20:49.469056 26335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:49.469311 26335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:49.469347 26335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:49.473268 26335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:49.473320 26335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:49.473335 26335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:49.473352 26335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:49.473367 26335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:49.477820 26335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:44721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:44721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:49.478791 26335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:49.480093 26335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:49.488581 26345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:49.488581 26348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.488668 26335 server_base.cc:1034] running on GCE node
W20260807 02:20:49.488577 26346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.489351 26335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:49.490353 26335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:49.491513 26335 hybrid_clock.cc:648] HybridClock initialized: now 1786069249491500 us; error 26 us; skew 500 ppm
I20260807 02:20:49.493347 26335 webserver.cc:460] Webserver started at http://127.1.126.254:32879/ using document root <none> and password file <none>
I20260807 02:20:49.493898 26335 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:49.493958 26335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:49.494199 26335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:49.496268 26335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "030fc464b7264c509cba558f7377f6e1"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "6489e733b080077de315ee7c656d3221"
server_key_iv: "fd7c701c49876cf0ec30d1130c49c706"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.496829 26335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "030fc464b7264c509cba558f7377f6e1"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "6489e733b080077de315ee7c656d3221"
server_key_iv: "fd7c701c49876cf0ec30d1130c49c706"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.500425 26335 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 02:20:49.502826 26357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.503971 26335 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:20:49.504112 26335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "030fc464b7264c509cba558f7377f6e1"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "6489e733b080077de315ee7c656d3221"
server_key_iv: "fd7c701c49876cf0ec30d1130c49c706"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.504230 26335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:49.516911 26335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:49.517550 26335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:49.517747 26335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:49.524470 26335 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:44721
I20260807 02:20:49.524479 26425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:44721 every 8 connection(s)
I20260807 02:20:49.525359 26335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:49.528487 26426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:49.533209 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 26335
I20260807 02:20:49.533360 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:49.533648 1531 external_mini_cluster.cc:1428] Setting key 4ea3cd199aaa2d57c93fc4564f47180b
I20260807 02:20:49.534085 26426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1: Bootstrap starting.
I20260807 02:20:49.536821 26426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:49.537710 26426 log.cc:824] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:49.539937 26426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1: No bootstrap required, opened a new log
I20260807 02:20:49.544503 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.535288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39678 (local address 127.1.126.254:44721)
0807 02:20:49.535953 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.535971 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.536012 (+ 41us) server_negotiation.cc:407] Connection header received
0807 02:20:49.536880 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.536903 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.537413 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.537763 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:49.538217 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.539662 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.540587 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.541258 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.541435 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.542252 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:49.542259 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:49.542276 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:49.542808 (+ 532us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:49.542878 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:49.542904 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:49.543012 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.543145 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.543487 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":120,"threads_started":1}
I20260807 02:20:49.544528 26426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "030fc464b7264c509cba558f7377f6e1" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44721 } }
I20260807 02:20:49.544822 26426 raft_consensus.cc:374] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:49.544883 26426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030fc464b7264c509cba558f7377f6e1, State: Initialized, Role: FOLLOWER
I20260807 02:20:49.545362 26426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "030fc464b7264c509cba558f7377f6e1" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44721 } }
I20260807 02:20:49.545521 26426 raft_consensus.cc:388] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:49.545672 26426 raft_consensus.cc:482] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:49.545804 26426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:49.546819 26426 raft_consensus.cc:504] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "030fc464b7264c509cba558f7377f6e1" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44721 } }
I20260807 02:20:49.547190 26426 leader_election.cc:302] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 030fc464b7264c509cba558f7377f6e1; no voters:
I20260807 02:20:49.547536 26426 leader_election.cc:288] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:49.547662 26433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:49.547915 26433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [term 1 LEADER]: Becoming Leader. State: Replica: 030fc464b7264c509cba558f7377f6e1, State: Running, Role: LEADER
I20260807 02:20:49.548269 26433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "030fc464b7264c509cba558f7377f6e1" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44721 } }
I20260807 02:20:49.548768 26426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:49.550091 26436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "030fc464b7264c509cba558f7377f6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "030fc464b7264c509cba558f7377f6e1" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44721 } } }
I20260807 02:20:49.550168 26437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 030fc464b7264c509cba558f7377f6e1. Latest consensus state: current_term: 1 leader_uuid: "030fc464b7264c509cba558f7377f6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "030fc464b7264c509cba558f7377f6e1" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44721 } } }
I20260807 02:20:49.550326 26437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:49.550326 26436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:49.550776 26450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:49.553890 26450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:49.559787 26450 catalog_manager.cc:1347] Generated new cluster ID: 503f0335ca5040d9aeac2373d6aaf910
I20260807 02:20:49.559861 26450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:49.570350 26450 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:49.571552 26450 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:49.585145 26450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1: Generated new TSK 0
I20260807 02:20:49.585911 26450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:20:49.592733 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44721
--builtin_ntp_servers=127.1.126.212:37541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 02:20:49.705404 26465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:49.705680 26465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:49.705750 26465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:49.709808 26465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:49.709878 26465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:49.709967 26465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:49.714783 26465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:49.715744 26465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:49.717087 26465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:49.726418 26475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:49.726428 26472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:49.726428 26471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.726780 26465 server_base.cc:1034] running on GCE node
I20260807 02:20:49.727165 26465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:49.727756 26465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:49.728938 26465 hybrid_clock.cc:648] HybridClock initialized: now 1786069249728926 us; error 32 us; skew 500 ppm
I20260807 02:20:49.730799 26465 webserver.cc:460] Webserver started at http://127.1.126.193:38163/ using document root <none> and password file <none>
I20260807 02:20:49.731357 26465 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:49.731451 26465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:49.731679 26465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:49.733582 26465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "1e7a1605ac0145db82a83e74a8a360ed"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "99403be66ad195ef11c36fade6c411a2"
server_key_iv: "2cfe36eaf3ed356efe2f3c204fc9cc99"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.734186 26465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "1e7a1605ac0145db82a83e74a8a360ed"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "99403be66ad195ef11c36fade6c411a2"
server_key_iv: "2cfe36eaf3ed356efe2f3c204fc9cc99"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.737660 26465 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:20:49.740139 26485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.741269 26465 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:20:49.741423 26465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "1e7a1605ac0145db82a83e74a8a360ed"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "99403be66ad195ef11c36fade6c411a2"
server_key_iv: "2cfe36eaf3ed356efe2f3c204fc9cc99"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.741531 26465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:49.752033 26465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:49.752615 26465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:49.752805 26465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:49.753340 26465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:49.754220 26465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:49.754289 26465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.754351 26465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:49.754395 26465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.763229 26465 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:46839
I20260807 02:20:49.763250 26657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:46839 every 8 connection(s)
I20260807 02:20:49.764055 26465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:49.769913 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 26465
I20260807 02:20:49.770038 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:20:49.770351 1531 external_mini_cluster.cc:1428] Setting key b36a11cc40fbbfc53be94587ccee3b88
I20260807 02:20:49.772384 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44721
--builtin_ntp_servers=127.1.126.212:37541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 02:20:49.773440 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.765878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:55635 (local address 127.1.126.254:44721)
0807 02:20:49.766022 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.766026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.767046 (+ 1020us) server_negotiation.cc:407] Connection header received
0807 02:20:49.768416 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.768418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.768463 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.768553 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:49.769421 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.770119 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.771396 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.771664 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.771785 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.772943 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:49.772952 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:49.772954 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:49.772966 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:49.772983 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:49.772991 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:49.773069 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.773249 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.773306 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:20:49.774192 26660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.766217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:44721 (local address 127.1.126.193:55635)
0807 02:20:49.766884 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.766921 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.768231 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.768718 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.768724 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.768799 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:49.769277 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.769290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.770280 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.770283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.771264 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.771275 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.771824 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.771828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.771993 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.772696 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:49.772698 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:49.772735 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:49.772794 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:49.773072 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:49.773085 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:49.773091 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.773235 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.773486 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":108,"threads_started":1}
I20260807 02:20:49.775331 26658 heartbeater.cc:347] Connected to a master server at 127.1.126.254:44721
I20260807 02:20:49.775563 26658 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:49.776163 26658 heartbeater.cc:511] Master 127.1.126.254:44721 requested a full tablet report, sending...
I20260807 02:20:49.777920 26379 ts_manager.cc:194] Registered new tserver with Master: 1e7a1605ac0145db82a83e74a8a360ed (127.1.126.193:46839)
I20260807 02:20:49.779641 26379 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.193:55635
W20260807 02:20:49.884268 26661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:49.884508 26661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:49.884544 26661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:49.888504 26661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:49.888551 26661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:49.888603 26661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:49.893186 26661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:49.894248 26661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:49.895936 26661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:49.905234 26675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:49.905228 26682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.905337 26661 server_base.cc:1034] running on GCE node
W20260807 02:20:49.905228 26679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:49.905997 26661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:49.906599 26661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:49.907756 26661 hybrid_clock.cc:648] HybridClock initialized: now 1786069249907728 us; error 39 us; skew 500 ppm
I20260807 02:20:49.909638 26661 webserver.cc:460] Webserver started at http://127.1.126.194:46693/ using document root <none> and password file <none>
I20260807 02:20:49.910157 26661 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:49.910219 26661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:49.910378 26661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:49.912477 26661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "22fbeb34206e42a08e8fd44d2e3c2872"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "bf0b823644fe3b35a3621f61f146c9d2"
server_key_iv: "0fe78f4427e442135f8e580dff680496"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.912981 26661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "22fbeb34206e42a08e8fd44d2e3c2872"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "bf0b823644fe3b35a3621f61f146c9d2"
server_key_iv: "0fe78f4427e442135f8e580dff680496"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.916445 26661 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 02:20:49.918802 26692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.919987 26661 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:20:49.920107 26661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "22fbeb34206e42a08e8fd44d2e3c2872"
format_stamp: "Formatted at 2026-08-07 02:20:49 on dist-test-slave-39l8"
server_key: "bf0b823644fe3b35a3621f61f146c9d2"
server_key_iv: "0fe78f4427e442135f8e580dff680496"
server_key_version: "encryptionkey@0"
I20260807 02:20:49.920209 26661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:49.963634 26661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:49.964372 26661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:49.964591 26661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:49.965207 26661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:49.966179 26661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:49.966228 26661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.966300 26661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:49.966332 26661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:49.975898 26661 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:40207
I20260807 02:20:49.975939 26856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:40207 every 8 connection(s)
I20260807 02:20:49.976804 26661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:49.980458 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 26661
I20260807 02:20:49.980607 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:20:49.980911 1531 external_mini_cluster.cc:1428] Setting key 9521a81c6ed4111f8948354bdb6ce3f8
I20260807 02:20:49.983022 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44721
--builtin_ntp_servers=127.1.126.212:37541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 02:20:49.986987 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.978645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:35639 (local address 127.1.126.254:44721)
0807 02:20:49.978835 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:49.978839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:49.979875 (+ 1036us) server_negotiation.cc:407] Connection header received
0807 02:20:49.981610 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:49.981614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:49.981669 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:49.981765 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:49.983252 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.983771 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.984925 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.985161 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.985296 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.986428 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:49.986432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:49.986434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:49.986448 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:49.986470 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:49.986486 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:49.986574 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:49.986748 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 02:20:49.986834 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 02:20:49.987859 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:49.979070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:44721 (local address 127.1.126.194:35639)
0807 02:20:49.979719 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:49.979759 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:49.981358 (+ 1599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:49.982398 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:49.982408 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:49.982517 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:49.983056 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.983078 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.983904 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.983906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.984773 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:49.984781 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:49.985337 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:49.985341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:49.985504 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:49.986165 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:49.986166 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:49.986206 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:49.986267 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:49.986569 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:49.986588 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:49.986596 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 02:20:49.986780 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 02:20:49.987102 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":112,"threads_started":1}
I20260807 02:20:49.989063 26857 heartbeater.cc:347] Connected to a master server at 127.1.126.254:44721
I20260807 02:20:49.989321 26857 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:49.989845 26857 heartbeater.cc:511] Master 127.1.126.254:44721 requested a full tablet report, sending...
I20260807 02:20:49.990989 26379 ts_manager.cc:194] Registered new tserver with Master: 22fbeb34206e42a08e8fd44d2e3c2872 (127.1.126.194:40207)
I20260807 02:20:49.991858 26379 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.194:35639
W20260807 02:20:50.102288 26861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:50.102507 26861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:50.102543 26861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:50.106433 26861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:50.106484 26861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:50.106535 26861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:50.111331 26861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:50.112336 26861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:50.113626 26861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:50.123014 26867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:50.123030 26868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:50.123030 26871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:50.123323 26861 server_base.cc:1034] running on GCE node
I20260807 02:20:50.123689 26861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:50.124342 26861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:50.125521 26861 hybrid_clock.cc:648] HybridClock initialized: now 1786069250125506 us; error 43 us; skew 500 ppm
I20260807 02:20:50.127322 26861 webserver.cc:460] Webserver started at http://127.1.126.195:46875/ using document root <none> and password file <none>
I20260807 02:20:50.127879 26861 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:50.127938 26861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:50.128188 26861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:50.130245 26861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73"
format_stamp: "Formatted at 2026-08-07 02:20:50 on dist-test-slave-39l8"
server_key: "12ed75c3410969581d3517a93fcd5bb9"
server_key_iv: "3aaaff385b641d59e4e0b637245a9bea"
server_key_version: "encryptionkey@0"
I20260807 02:20:50.130858 26861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73"
format_stamp: "Formatted at 2026-08-07 02:20:50 on dist-test-slave-39l8"
server_key: "12ed75c3410969581d3517a93fcd5bb9"
server_key_iv: "3aaaff385b641d59e4e0b637245a9bea"
server_key_version: "encryptionkey@0"
I20260807 02:20:50.134366 26861 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:20:50.136723 26879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:50.137866 26861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:50.138001 26861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73"
format_stamp: "Formatted at 2026-08-07 02:20:50 on dist-test-slave-39l8"
server_key: "12ed75c3410969581d3517a93fcd5bb9"
server_key_iv: "3aaaff385b641d59e4e0b637245a9bea"
server_key_version: "encryptionkey@0"
I20260807 02:20:50.138103 26861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:50.157631 26861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:50.158265 26861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:50.158457 26861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:50.159080 26861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:50.160027 26861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:50.160072 26861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:50.160143 26861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:50.160181 26861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:50.168526 26861 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:41605
I20260807 02:20:50.168550 27025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:41605 every 8 connection(s)
I20260807 02:20:50.169368 26861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:50.170195 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 26861
I20260807 02:20:50.170305 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:20:50.170599 1531 external_mini_cluster.cc:1428] Setting key 38c75fe96b234372371f3d8315e77193
I20260807 02:20:50.178679 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.171341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:55033 (local address 127.1.126.254:44721)
0807 02:20:50.171483 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.171490 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.172589 (+ 1099us) server_negotiation.cc:407] Connection header received
0807 02:20:50.174035 (+ 1446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.174038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.174091 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.174176 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:50.175076 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.175609 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.176743 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.176988 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.177099 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.178174 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:50.178178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:50.178181 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:50.178194 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:50.178222 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:50.178230 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:50.178307 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.178471 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.178530 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:20:50.179457 27028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.171755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:44721 (local address 127.1.126.195:55033)
0807 02:20:50.172457 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.172494 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:50.173823 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:50.174322 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:50.174328 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:50.174404 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:50.174942 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.174957 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.175743 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.175751 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.176587 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.176596 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.177133 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.177137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.177316 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.177914 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:50.177915 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:50.177954 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:50.178013 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:50.178322 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:50.178333 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:50.178344 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 02:20:50.178469 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 02:20:50.178759 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":178,"threads_started":1}
I20260807 02:20:50.180523 27026 heartbeater.cc:347] Connected to a master server at 127.1.126.254:44721
I20260807 02:20:50.180752 27026 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:50.181229 27026 heartbeater.cc:511] Master 127.1.126.254:44721 requested a full tablet report, sending...
I20260807 02:20:50.182219 26379 ts_manager.cc:194] Registered new tserver with Master: b15f9a5b7a7d4f2097ff3e29aee52d73 (127.1.126.195:41605)
I20260807 02:20:50.182838 26379 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.195:55033
I20260807 02:20:50.184554 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:50.189736 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.186414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.1.126.254:44721)
0807 02:20:50.186521 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.186525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.186680 (+ 155us) server_negotiation.cc:407] Connection header received
0807 02:20:50.186834 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.186837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.186872 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.186937 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:50.187196 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.187646 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.188452 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.188655 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.188729 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.189399 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:50.189402 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:50.189404 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:50.189414 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:50.189431 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:50.189438 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:50.189496 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.189591 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.189644 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:20:50.192313 26379 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:50.195231 26379 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:50.209254 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.203270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:40207 (local address 127.0.0.1:57612)
0807 02:20:50.204311 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.204360 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:50.204534 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:50.205083 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:50.205092 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:50.205121 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:50.205244 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.205251 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.206304 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.206307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.207551 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.207562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.208699 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.208702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.208807 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.208843 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 02:20:50.208983 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 02:20:50.209102 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":25,"thread_start_us":78,"threads_started":1}
I20260807 02:20:50.209262 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.203420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.1.126.194:40207)
0807 02:20:50.203853 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.203865 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.204445 (+ 580us) server_negotiation.cc:407] Connection header received
0807 02:20:50.204697 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.204705 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.204913 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.205064 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:50.205382 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.206185 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.207734 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.208571 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.208694 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.208880 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.209017 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.209105 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":114,"threads_started":1}
I20260807 02:20:50.209967 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.203831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36218 (local address 127.1.126.193:46839)
0807 02:20:50.204127 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.204139 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.204681 (+ 542us) server_negotiation.cc:407] Connection header received
0807 02:20:50.204774 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.204779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.205023 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.205178 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:50.205607 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.206830 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.208324 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.209087 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.209199 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.209368 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.209685 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.209796 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":108,"threads_started":1}
I20260807 02:20:50.210100 27041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.203686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:41605 (local address 127.0.0.1:44418)
0807 02:20:50.204770 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.204782 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:50.204860 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:50.205342 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:50.205345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:50.205374 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:50.205515 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.205521 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.207010 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.207015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.208431 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.208442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.209699 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.209703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.209796 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.209821 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 02:20:50.209891 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 02:20:50.209951 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"mutex_wait_us":215,"spinlock_wait_cycles":768,"thread_start_us":90,"threads_started":1}
I20260807 02:20:50.210100 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.203415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46839 (local address 127.0.0.1:36218)
0807 02:20:50.204392 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.204406 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:50.204529 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:50.205317 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:50.205319 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:50.205340 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:50.205480 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.205487 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.207075 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.207078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.208205 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.208215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.209437 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.209441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.209525 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.209547 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 02:20:50.209837 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 02:20:50.209919 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":26,"spinlock_wait_cycles":896,"thread_start_us":78,"threads_started":1}
I20260807 02:20:50.210811 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.204074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44418 (local address 127.1.126.195:41605)
0807 02:20:50.204478 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.204494 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.204955 (+ 461us) server_negotiation.cc:407] Connection header received
0807 02:20:50.205037 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.205041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.205203 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.205361 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:50.205671 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.206831 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.208593 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.209354 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.209458 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.209630 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.210496 (+ 866us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.210622 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":121,"threads_started":1}
I20260807 02:20:50.213027 26561 tablet_service.cc:1467] Processing CreateTablet for tablet 738567d1ce324d4da326f5be7550b6b4 (DEFAULT_TABLE table=test-table [id=393b8f24fdbf44279abcd98072cf553f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:50.212989 26759 tablet_service.cc:1467] Processing CreateTablet for tablet 738567d1ce324d4da326f5be7550b6b4 (DEFAULT_TABLE table=test-table [id=393b8f24fdbf44279abcd98072cf553f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:50.213347 26942 tablet_service.cc:1467] Processing CreateTablet for tablet 738567d1ce324d4da326f5be7550b6b4 (DEFAULT_TABLE table=test-table [id=393b8f24fdbf44279abcd98072cf553f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:50.214038 26561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 738567d1ce324d4da326f5be7550b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:50.214056 26759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 738567d1ce324d4da326f5be7550b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:50.214236 26942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 738567d1ce324d4da326f5be7550b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:50.220940 27048 tablet_bootstrap.cc:492] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Bootstrap starting.
I20260807 02:20:50.221496 27047 tablet_bootstrap.cc:492] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: Bootstrap starting.
I20260807 02:20:50.221520 27049 tablet_bootstrap.cc:492] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Bootstrap starting.
I20260807 02:20:50.223888 27047 tablet_bootstrap.cc:654] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:50.223888 27049 tablet_bootstrap.cc:654] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:50.224591 27048 tablet_bootstrap.cc:654] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:50.224781 27049 log.cc:824] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:50.224781 27047 log.cc:824] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:50.225368 27048 log.cc:824] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:50.226832 27049 tablet_bootstrap.cc:492] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: No bootstrap required, opened a new log
I20260807 02:20:50.227074 27049 ts_tablet_manager.cc:1397] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:20:50.227164 27047 tablet_bootstrap.cc:492] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: No bootstrap required, opened a new log
I20260807 02:20:50.227164 27048 tablet_bootstrap.cc:492] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: No bootstrap required, opened a new log
I20260807 02:20:50.227344 27047 ts_tablet_manager.cc:1397] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 02:20:50.227365 27048 ts_tablet_manager.cc:1397] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 02:20:50.230309 27048 raft_consensus.cc:348] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.230542 27048 raft_consensus.cc:374] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:50.230616 27048 raft_consensus.cc:729] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22fbeb34206e42a08e8fd44d2e3c2872, State: Initialized, Role: FOLLOWER
I20260807 02:20:50.231070 27048 consensus_queue.cc:260] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.231345 27047 raft_consensus.cc:348] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.231345 27049 raft_consensus.cc:348] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.231645 27047 raft_consensus.cc:374] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:50.231724 27047 raft_consensus.cc:729] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7a1605ac0145db82a83e74a8a360ed, State: Initialized, Role: FOLLOWER
I20260807 02:20:50.231750 26857 heartbeater.cc:503] Master 127.1.126.254:44721 was elected leader, sending a full tablet report...
I20260807 02:20:50.232134 27048 ts_tablet_manager.cc:1428] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:20:50.232187 27047 consensus_queue.cc:260] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.231581 27049 raft_consensus.cc:374] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:50.232839 26658 heartbeater.cc:503] Master 127.1.126.254:44721 was elected leader, sending a full tablet report...
I20260807 02:20:50.232950 27049 raft_consensus.cc:729] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15f9a5b7a7d4f2097ff3e29aee52d73, State: Initialized, Role: FOLLOWER
I20260807 02:20:50.233361 27049 consensus_queue.cc:260] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.234637 27049 ts_tablet_manager.cc:1428] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 02:20:50.234962 27026 heartbeater.cc:503] Master 127.1.126.254:44721 was elected leader, sending a full tablet report...
I20260807 02:20:50.235481 27047 ts_tablet_manager.cc:1428] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
W20260807 02:20:50.265298 26659 tablet.cc:2369] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:50.295184 27053 raft_consensus.cc:482] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:50.295442 27053 raft_consensus.cc:504] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.296648 27053 leader_election.cc:288] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e7a1605ac0145db82a83e74a8a360ed (127.1.126.193:46839), b15f9a5b7a7d4f2097ff3e29aee52d73 (127.1.126.195:41605)
I20260807 02:20:50.300328 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.296841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46839 (local address 127.1.126.194:59247)
0807 02:20:50.297025 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.297040 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:50.297136 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:50.297478 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:50.297481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:50.297500 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:50.297628 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.297634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.298381 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.298385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.299260 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.299270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.299892 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.299896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.299995 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.300012 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 02:20:50.300101 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 02:20:50.300177 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"spinlock_wait_cycles":16640}
I20260807 02:20:50.300326 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.296960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:59247 (local address 127.1.126.193:46839)
0807 02:20:50.297084 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.297088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.297106 (+ 18us) server_negotiation.cc:407] Connection header received
0807 02:20:50.297293 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.297299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.297363 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.297462 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:50.297747 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.298263 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.299387 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.299769 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.299895 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.299946 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.300119 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.300193 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:20:50.300542 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.297008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:41605 (local address 127.1.126.194:44655)
0807 02:20:50.297408 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.297419 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:50.297548 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:50.297836 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:50.297839 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:50.297855 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:50.297993 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.297998 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.298758 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.298765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.299502 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:50.299511 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.300110 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.300114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:50.300211 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.300250 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 02:20:50.300341 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 02:20:50.300409 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":161,"threads_started":1}
I20260807 02:20:50.300551 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.297124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:44655 (local address 127.1.126.195:41605)
0807 02:20:50.297272 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.297277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.297500 (+ 223us) server_negotiation.cc:407] Connection header received
0807 02:20:50.297669 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.297672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.297720 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.297824 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:50.298108 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.298592 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.299624 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.299991 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.300115 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.300160 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.300367 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.300450 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 02:20:50.301047 26586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738567d1ce324d4da326f5be7550b6b4" candidate_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7a1605ac0145db82a83e74a8a360ed" is_pre_election: true
I20260807 02:20:50.301308 26968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738567d1ce324d4da326f5be7550b6b4" candidate_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" is_pre_election: true
I20260807 02:20:50.301373 26586 raft_consensus.cc:2454] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22fbeb34206e42a08e8fd44d2e3c2872 in term 0.
I20260807 02:20:50.301620 26968 raft_consensus.cc:2454] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22fbeb34206e42a08e8fd44d2e3c2872 in term 0.
I20260807 02:20:50.301959 26694 leader_election.cc:302] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7a1605ac0145db82a83e74a8a360ed, 22fbeb34206e42a08e8fd44d2e3c2872; no voters:
I20260807 02:20:50.302291 27053 raft_consensus.cc:2781] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:50.302382 27053 raft_consensus.cc:482] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:50.302424 27053 raft_consensus.cc:3037] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:50.303478 27053 raft_consensus.cc:504] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.303814 27053 leader_election.cc:288] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [CANDIDATE]: Term 1 election: Requested vote from peers 1e7a1605ac0145db82a83e74a8a360ed (127.1.126.193:46839), b15f9a5b7a7d4f2097ff3e29aee52d73 (127.1.126.195:41605)
I20260807 02:20:50.304121 26586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738567d1ce324d4da326f5be7550b6b4" candidate_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7a1605ac0145db82a83e74a8a360ed"
I20260807 02:20:50.304186 26968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738567d1ce324d4da326f5be7550b6b4" candidate_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73"
I20260807 02:20:50.304279 26586 raft_consensus.cc:3037] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:50.304337 26968 raft_consensus.cc:3037] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:50.305308 26968 raft_consensus.cc:2454] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22fbeb34206e42a08e8fd44d2e3c2872 in term 1.
I20260807 02:20:50.305315 26586 raft_consensus.cc:2454] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22fbeb34206e42a08e8fd44d2e3c2872 in term 1.
I20260807 02:20:50.305629 26697 leader_election.cc:302] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22fbeb34206e42a08e8fd44d2e3c2872, b15f9a5b7a7d4f2097ff3e29aee52d73; no voters:
I20260807 02:20:50.305871 27053 raft_consensus.cc:2781] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:50.306092 27053 raft_consensus.cc:686] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 1 LEADER]: Becoming Leader. State: Replica: 22fbeb34206e42a08e8fd44d2e3c2872, State: Running, Role: LEADER
I20260807 02:20:50.306432 27053 consensus_queue.cc:237] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } }
I20260807 02:20:50.309633 26377 catalog_manager.cc:5495] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22fbeb34206e42a08e8fd44d2e3c2872 (127.1.126.194). New cstate: current_term: 1 leader_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22fbeb34206e42a08e8fd44d2e3c2872" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 40207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 } health_report { overall_health: UNKNOWN } } }
I20260807 02:20:50.333101 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.329871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57626 (local address 127.1.126.194:40207)
0807 02:20:50.329986 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:50.329989 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:50.330001 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:20:50.330067 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:50.330069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:50.330122 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:50.330218 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:50.330447 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.331004 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.331854 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:50.332059 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:50.332154 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:50.332407 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:50.332796 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:50.332884 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:50.332956 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 02:20:50.333000 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:20:50.338691 26968 raft_consensus.cc:1261] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 1 FOLLOWER]: Refusing update from remote peer 22fbeb34206e42a08e8fd44d2e3c2872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:50.338690 26586 raft_consensus.cc:1261] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 1 FOLLOWER]: Refusing update from remote peer 22fbeb34206e42a08e8fd44d2e3c2872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:50.339488 27058 consensus_queue.cc:1035] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b15f9a5b7a7d4f2097ff3e29aee52d73" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 41605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:50.339649 27053 consensus_queue.cc:1035] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7a1605ac0145db82a83e74a8a360ed" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 46839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:50.348754 27066 mvcc.cc:205] Tried to move back new op lower bound from 7315739649380360192 to 7315739649258246144. Current Snapshot: MvccSnapshot[applied={T|T < 7315739649380360192}]
I20260807 02:20:50.356192 26378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:50.356364 26378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:50.358786 26378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 030fc464b7264c509cba558f7377f6e1: Sending DeleteTablet for 3 replicas of tablet 738567d1ce324d4da326f5be7550b6b4
I20260807 02:20:50.359477 26561 tablet_service.cc:1514] Processing DeleteTablet for tablet 738567d1ce324d4da326f5be7550b6b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:50 UTC) from {username='slave'} at 127.0.0.1:36218
I20260807 02:20:50.359496 26759 tablet_service.cc:1514] Processing DeleteTablet for tablet 738567d1ce324d4da326f5be7550b6b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:50 UTC) from {username='slave'} at 127.0.0.1:57612
I20260807 02:20:50.359926 26942 tablet_service.cc:1514] Processing DeleteTablet for tablet 738567d1ce324d4da326f5be7550b6b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:50 UTC) from {username='slave'} at 127.0.0.1:44418
I20260807 02:20:50.360020 27080 tablet_replica.cc:330] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed: stopping tablet replica
I20260807 02:20:50.360342 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 26465
I20260807 02:20:50.360414 27079 tablet_replica.cc:330] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: stopping tablet replica
I20260807 02:20:50.360471 27080 raft_consensus.cc:2229] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:50.360674 27079 raft_consensus.cc:2229] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:20:50.360754 27080 raft_consensus.cc:2258] T 738567d1ce324d4da326f5be7550b6b4 P 1e7a1605ac0145db82a83e74a8a360ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:50.361105 27079 raft_consensus.cc:2258] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:50.363724 27079 ts_tablet_manager.cc:1905] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:50.366255 27081 tablet_replica.cc:330] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: stopping tablet replica
I20260807 02:20:50.366473 27079 ts_tablet_manager.cc:1918] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:50.366613 27081 raft_consensus.cc:2229] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:50.366647 27079 log.cc:1196] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/738567d1ce324d4da326f5be7550b6b4
I20260807 02:20:50.366988 27079 ts_tablet_manager.cc:1939] T 738567d1ce324d4da326f5be7550b6b4 P 22fbeb34206e42a08e8fd44d2e3c2872: Deleting consensus metadata
I20260807 02:20:50.367035 27081 raft_consensus.cc:2258] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:50.368188 26361 catalog_manager.cc:4841] TS 22fbeb34206e42a08e8fd44d2e3c2872 (127.1.126.194:40207): tablet 738567d1ce324d4da326f5be7550b6b4 (table test-table [id=393b8f24fdbf44279abcd98072cf553f]) successfully deleted
I20260807 02:20:50.368889 27081 ts_tablet_manager.cc:1905] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:50.372414 27081 ts_tablet_manager.cc:1918] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:50.372579 27081 log.cc:1196] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/738567d1ce324d4da326f5be7550b6b4
W20260807 02:20:50.372609 26358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:46839 (error 108)
I20260807 02:20:50.372915 27081 ts_tablet_manager.cc:1939] T 738567d1ce324d4da326f5be7550b6b4 P b15f9a5b7a7d4f2097ff3e29aee52d73: Deleting consensus metadata
I20260807 02:20:50.373643 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:50.373360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:46839 (local address 127.0.0.1:36232)
0807 02:20:50.373494 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:50.373562 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:46839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 02:20:50.373785 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 26661
W20260807 02:20:50.373879 26358 catalog_manager.cc:4584] TS 1e7a1605ac0145db82a83e74a8a360ed (127.1.126.193:46839): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 738567d1ce324d4da326f5be7550b6b4: Network error: Client connection negotiation failed: client connection to 127.1.126.193:46839: connect: Connection refused (error 111)
I20260807 02:20:50.383423 26359 catalog_manager.cc:4841] TS b15f9a5b7a7d4f2097ff3e29aee52d73 (127.1.126.195:41605): tablet 738567d1ce324d4da326f5be7550b6b4 (table test-table [id=393b8f24fdbf44279abcd98072cf553f]) successfully deleted
I20260807 02:20:50.388718 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 26861
I20260807 02:20:50.400636 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 26335
2026-08-07T02:20:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1078 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:20:50 dist-test-slave-39l8 krb5kdc[27090](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:20:50 dist-test-slave-39l8 krb5kdc[27090](info): set up 2 sockets
Aug 07 02:20:50 dist-test-slave-39l8 krb5kdc[27090](info): commencing operation
krb5kdc: starting...
W20260807 02:20:51.600593 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:20:51 dist-test-slave-39l8 krb5kdc[27090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:20:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:20:51.723580 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:44571
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:34471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:44571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:51.836422 27108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:51.836742 27108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:51.836824 27108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:51.840857 27108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:51.840950 27108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:51.840988 27108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:51.841048 27108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:51.841087 27108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:51.846405 27108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:44571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:44571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:51.847555 27108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:51.848632 27108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:51.857403 27114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:51.857452 27108 server_base.cc:1034] running on GCE node
W20260807 02:20:51.857414 27115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:51.857414 27118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:51.858358 27108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:51.859570 27108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:51.860759 27108 hybrid_clock.cc:648] HybridClock initialized: now 1786069251860742 us; error 35 us; skew 500 ppm
Aug 07 02:20:51 dist-test-slave-39l8 krb5kdc[27090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:51.867281 27108 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:20:51.868249 27108 webserver.cc:460] Webserver started at http://127.1.126.254:41799/ using document root <none> and password file <none>
I20260807 02:20:51.868855 27108 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:51.868952 27108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:51.869200 27108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:51.871380 27108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "9ec18cc4759e49988bda15889aed6670"
format_stamp: "Formatted at 2026-08-07 02:20:51 on dist-test-slave-39l8"
server_key: "8820b086e337a5ce1a9dc8ddeb40f716"
server_key_iv: "76ba0e26520ce528783b88b3d428346f"
server_key_version: "encryptionkey@0"
I20260807 02:20:51.871958 27108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "9ec18cc4759e49988bda15889aed6670"
format_stamp: "Formatted at 2026-08-07 02:20:51 on dist-test-slave-39l8"
server_key: "8820b086e337a5ce1a9dc8ddeb40f716"
server_key_iv: "76ba0e26520ce528783b88b3d428346f"
server_key_version: "encryptionkey@0"
I20260807 02:20:51.875733 27108 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:20:51.878160 27126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:51.879406 27108 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:51.879554 27108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "9ec18cc4759e49988bda15889aed6670"
format_stamp: "Formatted at 2026-08-07 02:20:51 on dist-test-slave-39l8"
server_key: "8820b086e337a5ce1a9dc8ddeb40f716"
server_key_iv: "76ba0e26520ce528783b88b3d428346f"
server_key_version: "encryptionkey@0"
I20260807 02:20:51.879669 27108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:51.893070 27108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:51.895879 27108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:51.896085 27108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:51.903429 27108 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:44571
I20260807 02:20:51.903453 27196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:44571 every 8 connection(s)
I20260807 02:20:51.904387 27108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:51.907164 27198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:51.909657 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 27108
I20260807 02:20:51.909792 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:51.910092 1531 external_mini_cluster.cc:1428] Setting key a20a9aacc91d8fe430b7e2f7c16add3c
I20260807 02:20:51.913379 27198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670: Bootstrap starting.
I20260807 02:20:51.915731 27198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:51.916517 27198 log.cc:824] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:51.918946 27198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670: No bootstrap required, opened a new log
Aug 07 02:20:51 dist-test-slave-39l8 krb5kdc[27090](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:51.921932 27198 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec18cc4759e49988bda15889aed6670" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44571 } }
I20260807 02:20:51.922189 27198 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:51.922271 27198 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ec18cc4759e49988bda15889aed6670, State: Initialized, Role: FOLLOWER
I20260807 02:20:51.922788 27198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec18cc4759e49988bda15889aed6670" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44571 } }
I20260807 02:20:51.922969 27198 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:51.923077 27198 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:51.923192 27198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:51.924348 27198 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec18cc4759e49988bda15889aed6670" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44571 } }
I20260807 02:20:51.924731 27198 leader_election.cc:302] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ec18cc4759e49988bda15889aed6670; no voters:
I20260807 02:20:51.925055 27198 leader_election.cc:288] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:51.925155 27205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:51.925434 27205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [term 1 LEADER]: Becoming Leader. State: Replica: 9ec18cc4759e49988bda15889aed6670, State: Running, Role: LEADER
I20260807 02:20:51.925716 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:51.911574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58624 (local address 127.1.126.254:44571)
0807 02:20:51.912031 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:51.912047 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:51.912086 (+ 39us) server_negotiation.cc:407] Connection header received
0807 02:20:51.912732 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:51.912748 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:51.913066 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:51.913405 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:51.914213 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:51.915342 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:51.916337 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:51.916962 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:51.917142 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:51.919938 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:51.919944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:51.919958 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:51.919985 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:51.922288 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:51.922838 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:51.922843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:51.922848 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:51.923010 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:51.923392 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:51.923399 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:51.923403 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:51.923920 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:51.924165 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:51.924350 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 02:20:51.924672 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":141,"threads_started":1}
I20260807 02:20:51.925870 27205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec18cc4759e49988bda15889aed6670" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44571 } }
I20260807 02:20:51.926373 27198 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:51.927127 27205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ec18cc4759e49988bda15889aed6670. Latest consensus state: current_term: 1 leader_uuid: "9ec18cc4759e49988bda15889aed6670" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec18cc4759e49988bda15889aed6670" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44571 } } }
I20260807 02:20:51.927426 27205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:51.927606 27206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ec18cc4759e49988bda15889aed6670" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec18cc4759e49988bda15889aed6670" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 44571 } } }
I20260807 02:20:51.927800 27206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:51.927947 27219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:51.931088 27219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:51.936538 27219 catalog_manager.cc:1347] Generated new cluster ID: ecc59d2159544278b13c89e5ec574281
I20260807 02:20:51.936610 27219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:51.956938 27219 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:51.957933 27219 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:51.965334 27219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670: Generated new TSK 0
I20260807 02:20:51.966188 27219 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:20:52.006309 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44571
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:34471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:52.129850 27237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:52.130156 27237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:52.130201 27237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:52.134574 27237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:52.134661 27237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:52.134805 27237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:52.140584 27237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:52.141798 27237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:52.143054 27237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:52.153429 27247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:52.153438 27245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:52.153465 27243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:52.153728 27237 server_base.cc:1034] running on GCE node
I20260807 02:20:52.154217 27237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:52.154983 27237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:52.156203 27237 hybrid_clock.cc:648] HybridClock initialized: now 1786069252156189 us; error 28 us; skew 500 ppm
Aug 07 02:20:52 dist-test-slave-39l8 krb5kdc[27090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:52.159191 27237 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:20:52.160143 27237 webserver.cc:460] Webserver started at http://127.1.126.193:39013/ using document root <none> and password file <none>
I20260807 02:20:52.160772 27237 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:52.160881 27237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:52.161154 27237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:52.163475 27237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "29a470945d674951854e14db5510e5b3"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "0a2f52acbcb70473d2f96950db644454"
server_key_iv: "683f596366cd7347c8676b605dbc6cb6"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.164099 27237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "29a470945d674951854e14db5510e5b3"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "0a2f52acbcb70473d2f96950db644454"
server_key_iv: "683f596366cd7347c8676b605dbc6cb6"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.168114 27237 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:20:52.170787 27256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.172089 27237 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:52.172250 27237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "29a470945d674951854e14db5510e5b3"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "0a2f52acbcb70473d2f96950db644454"
server_key_iv: "683f596366cd7347c8676b605dbc6cb6"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.172375 27237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:52.186187 27237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:52.189198 27237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:52.189419 27237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:52.190037 27237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:52.191004 27237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:52.191092 27237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.191183 27237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:52.191236 27237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.200350 27237 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:36359
I20260807 02:20:52.200387 27403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:36359 every 8 connection(s)
I20260807 02:20:52.201301 27237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:52.203879 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 27237
I20260807 02:20:52.204027 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:20:52.204393 1531 external_mini_cluster.cc:1428] Setting key 20057886969d2e59f8d3437af14e6e7e
Aug 07 02:20:52 dist-test-slave-39l8 krb5kdc[27090](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:20:52.217634 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.203238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:52721 (local address 127.1.126.254:44571)
0807 02:20:52.203392 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.203395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.204268 (+ 873us) server_negotiation.cc:407] Connection header received
0807 02:20:52.205842 (+ 1574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.205846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.205903 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.205975 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:52.207360 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.208261 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.210077 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.210307 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.210396 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.213605 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:52.213608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:52.213610 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:52.213635 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:52.215242 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.215884 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.215887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.215888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.215964 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.216417 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.216420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.216421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.216597 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:52.216673 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.217381 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.217487 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 02:20:52.218461 27407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.203609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:44571 (local address 127.1.126.193:52721)
0807 02:20:52.204093 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.204147 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.205610 (+ 1463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.206197 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.206204 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.206554 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:52.207124 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.207138 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.208450 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.208456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.209927 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.209943 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.210476 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.210484 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.210743 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.211432 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:52.211465 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:52.213418 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:52.215370 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:52.215380 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:52.215398 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:52.215775 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:52.216063 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:52.216094 (+ 31us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:52.216098 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:52.216304 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:52.216696 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:52.216701 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:52.217045 (+ 344us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.217326 (+ 281us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.217618 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":144,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:20:52.219851 27404 heartbeater.cc:347] Connected to a master server at 127.1.126.254:44571
I20260807 02:20:52.220112 27404 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:52.220718 27404 heartbeater.cc:511] Master 127.1.126.254:44571 requested a full tablet report, sending...
I20260807 02:20:52.222388 27148 ts_manager.cc:194] Registered new tserver with Master: 29a470945d674951854e14db5510e5b3 (127.1.126.193:36359)
I20260807 02:20:52.223721 27148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:52721
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:20:52.235549 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44571
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:34471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:52.350119 27410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:52.350363 27410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:52.350414 27410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:52.354563 27410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:52.354628 27410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:52.354739 27410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:52.360047 27410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:52.361112 27410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:52.362162 27410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:52.371950 27423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:52.371950 27419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:52.371968 27417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:52.372314 27410 server_base.cc:1034] running on GCE node
I20260807 02:20:52.372716 27410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:52.373356 27410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:52.374523 27410 hybrid_clock.cc:648] HybridClock initialized: now 1786069252374486 us; error 44 us; skew 500 ppm
Aug 07 02:20:52 dist-test-slave-39l8 krb5kdc[27090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:52.377333 27410 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:20:52.378188 27410 webserver.cc:460] Webserver started at http://127.1.126.194:35019/ using document root <none> and password file <none>
I20260807 02:20:52.378747 27410 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:52.378827 27410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:52.379000 27410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:52.380995 27410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "d7cc2ae786024c18827ca164b26d3ee2"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "076eac8cdf3c7d6046c038152a0ac5dd"
server_key_iv: "8ab05117529c51c2b41346a2816f0e7d"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.381508 27410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "d7cc2ae786024c18827ca164b26d3ee2"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "076eac8cdf3c7d6046c038152a0ac5dd"
server_key_iv: "8ab05117529c51c2b41346a2816f0e7d"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.385219 27410 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 02:20:52.387640 27431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.388937 27410 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 02:20:52.389076 27410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "d7cc2ae786024c18827ca164b26d3ee2"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "076eac8cdf3c7d6046c038152a0ac5dd"
server_key_iv: "8ab05117529c51c2b41346a2816f0e7d"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.389189 27410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:52.410471 27410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:52.413758 27410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:52.413987 27410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:52.414649 27410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:52.415583 27410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:52.415661 27410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.415742 27410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:52.415792 27410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.425623 27410 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:42289
I20260807 02:20:52.425729 27588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:42289 every 8 connection(s)
I20260807 02:20:52.426630 27410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:52.432737 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 27410
I20260807 02:20:52.432868 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:20:52.433184 1531 external_mini_cluster.cc:1428] Setting key 2d4486a6f516574a6cea123f0020eff7
Aug 07 02:20:52 dist-test-slave-39l8 krb5kdc[27090](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:52.441963 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.428670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:41775 (local address 127.1.126.254:44571)
0807 02:20:52.428809 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.428812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.429702 (+ 890us) server_negotiation.cc:407] Connection header received
0807 02:20:52.431067 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.431071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.431132 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.431238 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:52.432399 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.433077 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.434397 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.434787 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.434877 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.437704 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:52.437711 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:52.437716 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:52.437749 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:52.439332 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.440015 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.440019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.440020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.440101 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.440614 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.440617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.440618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.440791 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:52.440873 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.441570 (+ 697us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.441712 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:20:52.442615 27592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.429075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:44571 (local address 127.1.126.194:41775)
0807 02:20:52.429556 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.429597 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.430860 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.431403 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.431409 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.431773 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:52.432248 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.432262 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.433203 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.433212 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.434271 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.434282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.434944 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.434950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.435149 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.435781 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:52.435807 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:52.437529 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:52.439461 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:52.439471 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:52.439489 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:52.439896 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:52.440217 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:52.440224 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:52.440230 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:52.440441 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:52.440907 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:52.440914 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:52.441265 (+ 351us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.441478 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.441732 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":122,"threads_started":1}
I20260807 02:20:52.443910 27589 heartbeater.cc:347] Connected to a master server at 127.1.126.254:44571
I20260807 02:20:52.444154 27589 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:52.444648 27589 heartbeater.cc:511] Master 127.1.126.254:44571 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
I20260807 02:20:52.445775 27148 ts_manager.cc:194] Registered new tserver with Master: d7cc2ae786024c18827ca164b26d3ee2 (127.1.126.194:42289)
I20260807 02:20:52.446416 27148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:41775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:20:52.463491 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44571
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:34471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:52.576683 27595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:52.576958 27595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:52.577028 27595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:52.581264 27595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:52.581341 27595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:52.581459 27595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:52.587157 27595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:44571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:52.588166 27595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:52.589162 27595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:52.599063 27604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:52.599067 27605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:52.599314 27595 server_base.cc:1034] running on GCE node
W20260807 02:20:52.599391 27607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:52.599797 27595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:52.600420 27595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:52.601583 27595 hybrid_clock.cc:648] HybridClock initialized: now 1786069252601565 us; error 30 us; skew 500 ppm
Aug 07 02:20:52 dist-test-slave-39l8 krb5kdc[27090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:52.604260 27595 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:20:52.605062 27595 webserver.cc:460] Webserver started at http://127.1.126.195:40273/ using document root <none> and password file <none>
I20260807 02:20:52.605569 27595 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:52.605628 27595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:52.605789 27595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:52.607831 27595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "028c3bcf3ac540378fec75d1c6bdae4f"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "96b09b3ea0e37ec3a1b9d03b1b2875c6"
server_key_iv: "215bdc099f6012caaba3f259fe860fb8"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.608338 27595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "028c3bcf3ac540378fec75d1c6bdae4f"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "96b09b3ea0e37ec3a1b9d03b1b2875c6"
server_key_iv: "215bdc099f6012caaba3f259fe860fb8"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.611899 27595 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:20:52.614336 27616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.615646 27595 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:52.615744 27595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "028c3bcf3ac540378fec75d1c6bdae4f"
format_stamp: "Formatted at 2026-08-07 02:20:52 on dist-test-slave-39l8"
server_key: "96b09b3ea0e37ec3a1b9d03b1b2875c6"
server_key_iv: "215bdc099f6012caaba3f259fe860fb8"
server_key_version: "encryptionkey@0"
I20260807 02:20:52.615829 27595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:52.629670 27595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:52.632885 27595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:52.633031 27595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:52.633528 27595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:52.634298 27595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:52.634346 27595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.634383 27595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:52.634399 27595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:52.643178 27595 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:34837
I20260807 02:20:52.643193 27781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:34837 every 8 connection(s)
I20260807 02:20:52.644039 27595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:52.650463 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 27595
I20260807 02:20:52.650599 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:20:52.650969 1531 external_mini_cluster.cc:1428] Setting key bc9ab1148ac954e98b93fa1131025fec
Aug 07 02:20:52 dist-test-slave-39l8 krb5kdc[27090](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:52.657590 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.645839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:43913 (local address 127.1.126.254:44571)
0807 02:20:52.646008 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.646014 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.646865 (+ 851us) server_negotiation.cc:407] Connection header received
0807 02:20:52.648103 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.648105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.648164 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.648240 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:52.649489 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.650011 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.651618 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.651837 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.651951 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.654484 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:52.654487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:52.654489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:52.654513 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:52.655811 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.656269 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.656272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.656273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.656345 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.656638 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.656640 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.656642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.656811 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:52.656887 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.657362 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.657465 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 02:20:52.658350 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.646204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:44571 (local address 127.1.126.195:43913)
0807 02:20:52.646648 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.646759 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.647898 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.648432 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.648440 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.648859 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:52.649355 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.649368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.650165 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.650169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.651470 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.651480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.651989 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.651993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.652169 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.652793 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:52.652809 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:52.654340 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:52.655918 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:52.655922 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:52.655934 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:52.656183 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:52.656423 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:52.656425 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:52.656426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:52.656560 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:52.656897 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:52.656902 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:52.657134 (+ 232us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.657285 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.657521 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":105,"threads_started":1}
I20260807 02:20:52.659483 27782 heartbeater.cc:347] Connected to a master server at 127.1.126.254:44571
I20260807 02:20:52.659729 27782 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:52.660223 27782 heartbeater.cc:511] Master 127.1.126.254:44571 requested a full tablet report, sending...
I20260807 02:20:52.661228 27148 ts_manager.cc:194] Registered new tserver with Master: 028c3bcf3ac540378fec75d1c6bdae4f (127.1.126.195:34837)
I20260807 02:20:52.661794 27148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:43913
I20260807 02:20:52.664963 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:52.674115 27202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.666925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58638 (local address 127.1.126.254:44571)
0807 02:20:52.667040 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.667044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.667238 (+ 194us) server_negotiation.cc:407] Connection header received
0807 02:20:52.667320 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.667322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.667363 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.667436 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:52.668072 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.668571 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.669441 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.669649 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.669815 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.671355 (+ 1540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:52.671358 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:52.671360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:52.671387 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:52.672604 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.673062 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.673064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.673066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.673135 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:52.673398 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:52.673401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:52.673402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:52.673594 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:52.673718 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.673933 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.674007 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 02:20:52.676966 27148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:52.680145 27148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:52.694958 27800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.688621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52912 (local address 127.1.126.194:42289)
0807 02:20:52.689002 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.689014 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.689652 (+ 638us) server_negotiation.cc:407] Connection header received
0807 02:20:52.689760 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.689766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.689978 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.690161 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:52.690618 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.691479 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.693316 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.694166 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.694290 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.694433 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.694669 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.694808 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":179,"threads_started":1}
I20260807 02:20:52.694949 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.689407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:36359 (local address 127.0.0.1:60380)
0807 02:20:52.690040 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.690055 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.690135 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.690809 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.690812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.690835 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:52.690922 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.690928 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.692417 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.692420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.693518 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.693526 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.694354 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.694357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.694453 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.694496 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.694588 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.694761 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":88,"thread_start_us":104,"threads_started":1}
I20260807 02:20:52.694952 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.688533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:34837 (local address 127.0.0.1:52056)
0807 02:20:52.689668 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.689682 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.689897 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.690626 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.690629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.690646 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:52.690755 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.690762 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.692207 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.692211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.693255 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.693271 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.694315 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.694322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.694557 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.694578 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.694680 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.694781 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"mutex_wait_us":90,"thread_start_us":77,"threads_started":1}
I20260807 02:20:52.695379 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.688471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42289 (local address 127.0.0.1:52912)
0807 02:20:52.689323 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.689370 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.689494 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.690350 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.690355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.690375 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:52.690472 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.690476 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.691613 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.691619 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.693193 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.693204 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.694424 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.694428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.694494 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.694510 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.694615 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.694755 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":6,"thread_start_us":76,"threads_started":1}
I20260807 02:20:52.695585 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.689966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60380 (local address 127.1.126.193:36359)
0807 02:20:52.690347 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.690361 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.690380 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:20:52.690443 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.690448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.690631 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.691073 (+ 442us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:52.691227 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.692278 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.693651 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.694206 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.694841 (+ 635us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.694985 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.695262 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.695362 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":119,"threads_started":1}
I20260807 02:20:52.695966 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.689296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52056 (local address 127.1.126.195:34837)
0807 02:20:52.690176 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.690190 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.690215 (+ 25us) server_negotiation.cc:407] Connection header received
0807 02:20:52.690288 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.690293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.690470 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.690655 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:52.690852 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.692000 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.693405 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.694169 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.694290 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.694433 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.695628 (+ 1195us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.695826 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":105,"threads_started":1}
I20260807 02:20:52.698267 27497 tablet_service.cc:1467] Processing CreateTablet for tablet a540177fbe404f52bccce6f385dc8d85 (DEFAULT_TABLE table=test-table [id=a7f27c70d47b48a294aafa727ee40bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:52.698421 27684 tablet_service.cc:1467] Processing CreateTablet for tablet a540177fbe404f52bccce6f385dc8d85 (DEFAULT_TABLE table=test-table [id=a7f27c70d47b48a294aafa727ee40bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:52.698419 27318 tablet_service.cc:1467] Processing CreateTablet for tablet a540177fbe404f52bccce6f385dc8d85 (DEFAULT_TABLE table=test-table [id=a7f27c70d47b48a294aafa727ee40bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:52.699311 27497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a540177fbe404f52bccce6f385dc8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:52.699443 27318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a540177fbe404f52bccce6f385dc8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:52.699451 27684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a540177fbe404f52bccce6f385dc8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:52.707187 27804 tablet_bootstrap.cc:492] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Bootstrap starting.
I20260807 02:20:52.707629 27806 tablet_bootstrap.cc:492] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Bootstrap starting.
I20260807 02:20:52.709314 27806 tablet_bootstrap.cc:654] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:52.709527 27804 tablet_bootstrap.cc:654] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:52.710515 27804 log.cc:824] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:52.710561 27806 log.cc:824] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:52.711274 27805 tablet_bootstrap.cc:492] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: Bootstrap starting.
I20260807 02:20:52.712360 27806 tablet_bootstrap.cc:492] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: No bootstrap required, opened a new log
I20260807 02:20:52.712574 27806 ts_tablet_manager.cc:1397] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 02:20:52.713013 27805 tablet_bootstrap.cc:654] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:52.713961 27805 log.cc:824] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:52.715461 27804 tablet_bootstrap.cc:492] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: No bootstrap required, opened a new log
I20260807 02:20:52.715689 27804 ts_tablet_manager.cc:1397] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260807 02:20:52.715875 27805 tablet_bootstrap.cc:492] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: No bootstrap required, opened a new log
I20260807 02:20:52.716044 27805 ts_tablet_manager.cc:1397] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 02:20:52.715843 27806 raft_consensus.cc:348] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.716135 27806 raft_consensus.cc:374] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:52.716192 27806 raft_consensus.cc:729] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 028c3bcf3ac540378fec75d1c6bdae4f, State: Initialized, Role: FOLLOWER
I20260807 02:20:52.716657 27806 consensus_queue.cc:260] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.717643 27806 ts_tablet_manager.cc:1428] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 02:20:52.717986 27782 heartbeater.cc:503] Master 127.1.126.254:44571 was elected leader, sending a full tablet report...
I20260807 02:20:52.719458 27804 raft_consensus.cc:348] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.719759 27804 raft_consensus.cc:374] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:52.719830 27804 raft_consensus.cc:729] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7cc2ae786024c18827ca164b26d3ee2, State: Initialized, Role: FOLLOWER
I20260807 02:20:52.719764 27805 raft_consensus.cc:348] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.720006 27805 raft_consensus.cc:374] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:52.720073 27805 raft_consensus.cc:729] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a470945d674951854e14db5510e5b3, State: Initialized, Role: FOLLOWER
I20260807 02:20:52.720276 27804 consensus_queue.cc:260] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.720534 27805 consensus_queue.cc:260] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.721030 27589 heartbeater.cc:503] Master 127.1.126.254:44571 was elected leader, sending a full tablet report...
I20260807 02:20:52.721280 27804 ts_tablet_manager.cc:1428] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:20:52.721441 27805 ts_tablet_manager.cc:1428] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 02:20:52.721792 27404 heartbeater.cc:503] Master 127.1.126.254:44571 was elected leader, sending a full tablet report...
I20260807 02:20:52.886397 27810 raft_consensus.cc:482] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:52.886641 27810 raft_consensus.cc:504] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.887881 27810 leader_election.cc:288] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7cc2ae786024c18827ca164b26d3ee2 (127.1.126.194:42289), 29a470945d674951854e14db5510e5b3 (127.1.126.193:36359)
I20260807 02:20:52.892835 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.888175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:42289 (local address 127.1.126.195:33645)
0807 02:20:52.888327 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.888346 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.888469 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.888827 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.888830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.888851 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:52.888995 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.889005 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.890023 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.890025 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.891340 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.891351 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.892235 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.892238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.892418 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.892512 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.892589 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.892683 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":52}
I20260807 02:20:52.892844 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.888180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:36359 (local address 127.1.126.195:55461)
0807 02:20:52.888851 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.888865 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:52.888964 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:52.889237 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:52.889239 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:52.889257 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:52.889352 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.889356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.890236 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.890239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.891465 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:52.891475 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.892296 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.892299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:52.892505 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.892523 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 02:20:52.892655 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 02:20:52.892706 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"mutex_wait_us":376,"thread_start_us":147,"threads_started":1}
I20260807 02:20:52.892861 27800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.888272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:33645 (local address 127.1.126.194:42289)
0807 02:20:52.888404 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.888410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.888430 (+ 20us) server_negotiation.cc:407] Connection header received
0807 02:20:52.888611 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.888618 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.888700 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.888794 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:52.889131 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.889911 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.891466 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.892116 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.892252 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.892314 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.892639 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.892734 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 02:20:52.892861 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.888392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:55461 (local address 127.1.126.193:36359)
0807 02:20:52.888559 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.888566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.888973 (+ 407us) server_negotiation.cc:407] Connection header received
0807 02:20:52.889036 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.889039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.889126 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.889220 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:52.889463 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.890136 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.891596 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.892198 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.892299 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.892351 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.892688 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.892753 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 02:20:52.893594 27345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a540177fbe404f52bccce6f385dc8d85" candidate_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29a470945d674951854e14db5510e5b3" is_pre_election: true
I20260807 02:20:52.893574 27529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a540177fbe404f52bccce6f385dc8d85" candidate_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7cc2ae786024c18827ca164b26d3ee2" is_pre_election: true
I20260807 02:20:52.893944 27345 raft_consensus.cc:2454] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 028c3bcf3ac540378fec75d1c6bdae4f in term 0.
I20260807 02:20:52.893957 27529 raft_consensus.cc:2454] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 028c3bcf3ac540378fec75d1c6bdae4f in term 0.
I20260807 02:20:52.894474 27623 leader_election.cc:302] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 028c3bcf3ac540378fec75d1c6bdae4f, 29a470945d674951854e14db5510e5b3; no voters:
I20260807 02:20:52.894780 27810 raft_consensus.cc:2781] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:52.894871 27810 raft_consensus.cc:482] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:52.894925 27810 raft_consensus.cc:3037] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 0 FOLLOWER]: Advancing to term 1
W20260807 02:20:52.895025 27785 tablet.cc:2369] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:52.896015 27810 raft_consensus.cc:504] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.896415 27810 leader_election.cc:288] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [CANDIDATE]: Term 1 election: Requested vote from peers d7cc2ae786024c18827ca164b26d3ee2 (127.1.126.194:42289), 29a470945d674951854e14db5510e5b3 (127.1.126.193:36359)
I20260807 02:20:52.896791 27345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a540177fbe404f52bccce6f385dc8d85" candidate_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29a470945d674951854e14db5510e5b3"
I20260807 02:20:52.896823 27529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a540177fbe404f52bccce6f385dc8d85" candidate_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7cc2ae786024c18827ca164b26d3ee2"
I20260807 02:20:52.896924 27529 raft_consensus.cc:3037] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:52.896924 27345 raft_consensus.cc:3037] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:52.898277 27529 raft_consensus.cc:2454] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 028c3bcf3ac540378fec75d1c6bdae4f in term 1.
I20260807 02:20:52.898277 27345 raft_consensus.cc:2454] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 028c3bcf3ac540378fec75d1c6bdae4f in term 1.
I20260807 02:20:52.898622 27621 leader_election.cc:302] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 028c3bcf3ac540378fec75d1c6bdae4f, d7cc2ae786024c18827ca164b26d3ee2; no voters:
I20260807 02:20:52.898854 27810 raft_consensus.cc:2781] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:52.899096 27810 raft_consensus.cc:686] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 1 LEADER]: Becoming Leader. State: Replica: 028c3bcf3ac540378fec75d1c6bdae4f, State: Running, Role: LEADER
I20260807 02:20:52.899438 27810 consensus_queue.cc:237] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } }
I20260807 02:20:52.902503 27147 catalog_manager.cc:5495] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 028c3bcf3ac540378fec75d1c6bdae4f (127.1.126.195). New cstate: current_term: 1 leader_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "028c3bcf3ac540378fec75d1c6bdae4f" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 } health_report { overall_health: UNKNOWN } } }
W20260807 02:20:52.927977 27590 tablet.cc:2369] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:52.930498 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.926437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52072 (local address 127.1.126.195:34837)
0807 02:20:52.926595 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:52.926598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:52.926615 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:20:52.926798 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:52.926801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:52.926859 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:52.926952 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:52.927222 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.927850 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.928949 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:52.929183 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:52.929297 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:52.929626 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:52.930015 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:52.930185 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:52.930285 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 02:20:52.930331 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:20:52.936357 27529 raft_consensus.cc:1261] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 1 FOLLOWER]: Refusing update from remote peer 028c3bcf3ac540378fec75d1c6bdae4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:52.936367 27345 raft_consensus.cc:1261] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 1 FOLLOWER]: Refusing update from remote peer 028c3bcf3ac540378fec75d1c6bdae4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:52.937109 27810 consensus_queue.cc:1035] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7cc2ae786024c18827ca164b26d3ee2" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:52.937361 27816 consensus_queue.cc:1035] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "29a470945d674951854e14db5510e5b3" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 36359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:52.955080 27147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:52.955291 27147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:52.957931 27147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ec18cc4759e49988bda15889aed6670: Sending DeleteTablet for 3 replicas of tablet a540177fbe404f52bccce6f385dc8d85
I20260807 02:20:52.958858 27684 tablet_service.cc:1514] Processing DeleteTablet for tablet a540177fbe404f52bccce6f385dc8d85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:52056
I20260807 02:20:52.958895 27318 tablet_service.cc:1514] Processing DeleteTablet for tablet a540177fbe404f52bccce6f385dc8d85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:60380
I20260807 02:20:52.958899 27497 tablet_service.cc:1514] Processing DeleteTablet for tablet a540177fbe404f52bccce6f385dc8d85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:52912
I20260807 02:20:52.959391 27837 tablet_replica.cc:330] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3: stopping tablet replica
I20260807 02:20:52.959755 27837 raft_consensus.cc:2229] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:52.959861 27838 tablet_replica.cc:330] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: stopping tablet replica
I20260807 02:20:52.960103 27837 raft_consensus.cc:2258] T a540177fbe404f52bccce6f385dc8d85 P 29a470945d674951854e14db5510e5b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:52.960148 27838 raft_consensus.cc:2229] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:52.960500 27836 tablet_replica.cc:330] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: stopping tablet replica
I20260807 02:20:52.960593 27838 raft_consensus.cc:2258] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:52.960636 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 27237
I20260807 02:20:52.961526 27836 raft_consensus.cc:2229] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:20:52.961987 27836 raft_consensus.cc:2258] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:52.967231 27838 ts_tablet_manager.cc:1905] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:52.969661 27838 ts_tablet_manager.cc:1918] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:52.969784 27838 log.cc:1196] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/a540177fbe404f52bccce6f385dc8d85
I20260807 02:20:52.970096 27838 ts_tablet_manager.cc:1939] T a540177fbe404f52bccce6f385dc8d85 P d7cc2ae786024c18827ca164b26d3ee2: Deleting consensus metadata
I20260807 02:20:52.971452 27133 catalog_manager.cc:4841] TS d7cc2ae786024c18827ca164b26d3ee2 (127.1.126.194:42289): tablet a540177fbe404f52bccce6f385dc8d85 (table test-table [id=a7f27c70d47b48a294aafa727ee40bed]) successfully deleted
I20260807 02:20:52.972224 27836 ts_tablet_manager.cc:1905] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 02:20:52.973544 27134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:36359 (error 108)
I20260807 02:20:52.974676 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:52.974329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:36359 (local address 127.0.0.1:60396)
0807 02:20:52.974486 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:52.974567 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:36359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 02:20:52.974754 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 27410
I20260807 02:20:52.974804 27836 ts_tablet_manager.cc:1918] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:52.974911 27836 log.cc:1196] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/a540177fbe404f52bccce6f385dc8d85
I20260807 02:20:52.975221 27836 ts_tablet_manager.cc:1939] T a540177fbe404f52bccce6f385dc8d85 P 028c3bcf3ac540378fec75d1c6bdae4f: Deleting consensus metadata
I20260807 02:20:52.976275 27131 catalog_manager.cc:4841] TS 028c3bcf3ac540378fec75d1c6bdae4f (127.1.126.195:34837): tablet a540177fbe404f52bccce6f385dc8d85 (table test-table [id=a7f27c70d47b48a294aafa727ee40bed]) successfully deleted
W20260807 02:20:52.987892 27134 catalog_manager.cc:4584] TS 29a470945d674951854e14db5510e5b3 (127.1.126.193:36359): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a540177fbe404f52bccce6f385dc8d85: Network error: Client connection negotiation failed: client connection to 127.1.126.193:36359: connect: Connection refused (error 111)
I20260807 02:20:52.995333 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 27595
I20260807 02:20:53.007608 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 27108
2026-08-07T02:20:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2612 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T02:20:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:53Z Disabled control of system clock
I20260807 02:20:53.048586 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:43997
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:43997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 02:20:53.163195 27845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:53.163492 27845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:53.163549 27845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:53.167523 27845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:53.167572 27845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:53.167590 27845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:53.167608 27845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:53.167622 27845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:53.172309 27845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:43997
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:43997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:53.173280 27845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:53.174625 27845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:53.183049 27855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.183055 27851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.183055 27853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:53.183410 27845 server_base.cc:1034] running on GCE node
I20260807 02:20:53.183979 27845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:53.184967 27845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:53.186139 27845 hybrid_clock.cc:648] HybridClock initialized: now 1786069253186119 us; error 31 us; skew 500 ppm
I20260807 02:20:53.188081 27845 webserver.cc:460] Webserver started at http://127.1.126.254:33529/ using document root <none> and password file <none>
I20260807 02:20:53.188685 27845 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:53.188748 27845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:53.188988 27845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:53.191054 27845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "fd440e81be6e4620943148ade8326c00"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "10a668d047a78acd3704161c3e2cd291"
server_key_iv: "6c99c7943b01c348db2ef0d59cd05e88"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.191624 27845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "fd440e81be6e4620943148ade8326c00"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "10a668d047a78acd3704161c3e2cd291"
server_key_iv: "6c99c7943b01c348db2ef0d59cd05e88"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.195225 27845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:20:53.197556 27864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.198815 27845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:53.198957 27845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "fd440e81be6e4620943148ade8326c00"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "10a668d047a78acd3704161c3e2cd291"
server_key_iv: "6c99c7943b01c348db2ef0d59cd05e88"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.199067 27845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:53.222143 27845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:53.222975 27845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:53.223184 27845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:53.230358 27845 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:43997
I20260807 02:20:53.230382 27939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:43997 every 8 connection(s)
I20260807 02:20:53.231333 27845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:53.234544 27940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:53.234844 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 27845
I20260807 02:20:53.234987 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:53.235306 1531 external_mini_cluster.cc:1428] Setting key 3a8c42fa6d8da0e71d2e3c361406f8bb
I20260807 02:20:53.241659 27940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00: Bootstrap starting.
I20260807 02:20:53.244454 27940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:53.244778 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.236691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53760 (local address 127.1.126.254:43997)
0807 02:20:53.237333 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.237354 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.237390 (+ 36us) server_negotiation.cc:407] Connection header received
0807 02:20:53.238066 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.238084 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.238524 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.238876 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:53.239221 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.240168 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.241417 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.241921 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.242038 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.242958 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:53.242963 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:53.242976 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:53.243367 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:53.243419 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:53.243439 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:53.243520 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.243726 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.244015 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":150,"threads_started":1}
I20260807 02:20:53.245421 27940 log.cc:824] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:53.247499 27940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00: No bootstrap required, opened a new log
I20260807 02:20:53.251391 27940 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd440e81be6e4620943148ade8326c00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43997 } }
I20260807 02:20:53.251703 27940 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:53.251787 27940 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd440e81be6e4620943148ade8326c00, State: Initialized, Role: FOLLOWER
I20260807 02:20:53.252287 27940 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd440e81be6e4620943148ade8326c00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43997 } }
I20260807 02:20:53.252416 27940 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:53.252465 27940 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:53.252540 27940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:53.253459 27940 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd440e81be6e4620943148ade8326c00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43997 } }
I20260807 02:20:53.253758 27940 leader_election.cc:302] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd440e81be6e4620943148ade8326c00; no voters:
I20260807 02:20:53.254047 27940 leader_election.cc:288] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:53.254211 27947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:53.254472 27947 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [term 1 LEADER]: Becoming Leader. State: Replica: fd440e81be6e4620943148ade8326c00, State: Running, Role: LEADER
I20260807 02:20:53.254818 27947 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd440e81be6e4620943148ade8326c00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43997 } }
I20260807 02:20:53.255442 27940 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:53.256542 27950 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd440e81be6e4620943148ade8326c00. Latest consensus state: current_term: 1 leader_uuid: "fd440e81be6e4620943148ade8326c00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd440e81be6e4620943148ade8326c00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43997 } } }
I20260807 02:20:53.256686 27950 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:53.256966 27949 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd440e81be6e4620943148ade8326c00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd440e81be6e4620943148ade8326c00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43997 } } }
I20260807 02:20:53.257079 27949 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00 [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:53.257164 27959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:53.260372 27959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:53.265576 27959 catalog_manager.cc:1347] Generated new cluster ID: b670cba98b7c412389349ce84fc95bf0
I20260807 02:20:53.265648 27959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:53.291929 27959 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:53.292989 27959 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:53.299118 27959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00: Generated new TSK 0
I20260807 02:20:53.299926 27959 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:20:53.303062 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43997
--builtin_ntp_servers=127.1.126.212:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 02:20:53.418968 27970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:53.419265 27970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:53.419348 27970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:53.423486 27970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:53.423573 27970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:53.423666 27970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:53.428395 27970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:53.429483 27970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:53.430918 27970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:53.440474 27977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.440526 27978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.440485 27983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:53.440675 27970 server_base.cc:1034] running on GCE node
I20260807 02:20:53.441224 27970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:53.441831 27970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:53.443027 27970 hybrid_clock.cc:648] HybridClock initialized: now 1786069253443018 us; error 29 us; skew 500 ppm
I20260807 02:20:53.444896 27970 webserver.cc:460] Webserver started at http://127.1.126.193:36635/ using document root <none> and password file <none>
I20260807 02:20:53.445482 27970 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:53.445576 27970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:53.445828 27970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:53.447868 27970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "47c2909f0e43402a9b70347de52d5925"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "3e812d1e038cf6e74a7a846ea0b6bd91"
server_key_iv: "e701b87f71b2acc16a12ab2794e732c5"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.448454 27970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "47c2909f0e43402a9b70347de52d5925"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "3e812d1e038cf6e74a7a846ea0b6bd91"
server_key_iv: "e701b87f71b2acc16a12ab2794e732c5"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.452106 27970 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:20:53.454523 27994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.455924 27970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:53.456079 27970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "47c2909f0e43402a9b70347de52d5925"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "3e812d1e038cf6e74a7a846ea0b6bd91"
server_key_iv: "e701b87f71b2acc16a12ab2794e732c5"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.456192 27970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:53.482448 27970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:53.483215 27970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:53.483428 27970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:53.484107 27970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:53.485103 27970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:53.485178 27970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.485255 27970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:53.485304 27970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.494679 27970 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:40949
I20260807 02:20:53.494755 28136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:40949 every 8 connection(s)
I20260807 02:20:53.495677 27970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:53.501084 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 27970
I20260807 02:20:53.501240 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:20:53.501550 1531 external_mini_cluster.cc:1428] Setting key 14ab073429a6dccd6050ae448a9c97bb
I20260807 02:20:53.503810 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43997
--builtin_ntp_servers=127.1.126.212:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 02:20:53.506397 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.497546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:59447 (local address 127.1.126.254:43997)
0807 02:20:53.497703 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.497708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.498826 (+ 1118us) server_negotiation.cc:407] Connection header received
0807 02:20:53.500476 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.500479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.500542 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.500621 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:53.501669 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.502351 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.504111 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.504332 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.504420 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.505804 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:53.505810 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:53.505813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:53.505832 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:53.505858 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:53.505871 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:53.505955 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.506125 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.506201 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:20:53.507221 28141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.498004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:43997 (local address 127.1.126.193:59447)
0807 02:20:53.498654 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.498694 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.500242 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.500792 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.500798 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.500881 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:53.501506 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.501526 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.502493 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.502496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.503930 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.503944 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.504503 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.504509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.504768 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.505452 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:53.505456 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:53.505512 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:53.505611 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:53.505967 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:53.505975 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:53.505980 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.506093 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.506315 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":113,"threads_started":1}
I20260807 02:20:53.508533 28137 heartbeater.cc:347] Connected to a master server at 127.1.126.254:43997
I20260807 02:20:53.508808 28137 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:53.509352 28137 heartbeater.cc:511] Master 127.1.126.254:43997 requested a full tablet report, sending...
I20260807 02:20:53.511143 27892 ts_manager.cc:194] Registered new tserver with Master: 47c2909f0e43402a9b70347de52d5925 (127.1.126.193:40949)
I20260807 02:20:53.512967 27892 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.193:59447
W20260807 02:20:53.619681 28144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:53.619997 28144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:53.620044 28144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:53.624167 28144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:53.624219 28144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:53.624275 28144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:53.628904 28144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:53.629876 28144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:53.631218 28144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:53.640904 28156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:53.640990 28144 server_base.cc:1034] running on GCE node
W20260807 02:20:53.640897 28155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.640897 28160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:53.641620 28144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:53.642195 28144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:53.643356 28144 hybrid_clock.cc:648] HybridClock initialized: now 1786069253643343 us; error 24 us; skew 500 ppm
I20260807 02:20:53.645224 28144 webserver.cc:460] Webserver started at http://127.1.126.194:39737/ using document root <none> and password file <none>
I20260807 02:20:53.645809 28144 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:53.645872 28144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:53.646087 28144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:53.648178 28144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "2cf5b22710734cd7b02dba767db1a90f"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "31444174ecdc7ead4193175d6b8b4711"
server_key_iv: "5efe19b8aeddce498805d045c1539e4a"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.648741 28144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "2cf5b22710734cd7b02dba767db1a90f"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "31444174ecdc7ead4193175d6b8b4711"
server_key_iv: "5efe19b8aeddce498805d045c1539e4a"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.652438 28144 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:20:53.654803 28169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.656149 28144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:53.656267 28144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "2cf5b22710734cd7b02dba767db1a90f"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "31444174ecdc7ead4193175d6b8b4711"
server_key_iv: "5efe19b8aeddce498805d045c1539e4a"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.656409 28144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:53.666874 28144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:53.667505 28144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:53.667691 28144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:53.668253 28144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:53.669166 28144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:53.669214 28144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.669284 28144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:53.669322 28144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.678369 28144 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:33957
I20260807 02:20:53.678396 28316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:33957 every 8 connection(s)
I20260807 02:20:53.679343 28144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:53.681583 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 28144
I20260807 02:20:53.681726 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:20:53.682096 1531 external_mini_cluster.cc:1428] Setting key 1b6e6b5ec6f654876bb93d7741a16d3b
I20260807 02:20:53.684204 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43997
--builtin_ntp_servers=127.1.126.212:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 02:20:53.688841 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.681127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58355 (local address 127.1.126.254:43997)
0807 02:20:53.681282 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.681286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.682514 (+ 1228us) server_negotiation.cc:407] Connection header received
0807 02:20:53.684122 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.684125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.684189 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.684268 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:53.685121 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.685651 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.686877 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.687112 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.687230 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.688381 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:53.688384 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:53.688386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:53.688398 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:53.688418 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:53.688427 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:53.688490 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.688682 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.688733 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 02:20:53.690057 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.681598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:43997 (local address 127.1.126.194:58355)
0807 02:20:53.682369 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.682410 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.683920 (+ 1510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.684434 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.684441 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.684521 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:53.684977 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.684989 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.685789 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.685797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.686645 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.686654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.687282 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.687287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.687454 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.688065 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:53.688069 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:53.688122 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:53.688209 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:53.688518 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:53.688529 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:53.688538 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.688674 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.688963 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":154,"threads_started":1}
I20260807 02:20:53.691272 28317 heartbeater.cc:347] Connected to a master server at 127.1.126.254:43997
I20260807 02:20:53.691533 28317 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:53.692216 28317 heartbeater.cc:511] Master 127.1.126.254:43997 requested a full tablet report, sending...
I20260807 02:20:53.693362 27892 ts_manager.cc:194] Registered new tserver with Master: 2cf5b22710734cd7b02dba767db1a90f (127.1.126.194:33957)
I20260807 02:20:53.693938 27892 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.194:58355
W20260807 02:20:53.800806 28320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:53.801096 28320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:53.801177 28320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:53.805341 28320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:53.805410 28320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:53.805495 28320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:53.810235 28320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:53.811324 28320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:53.812714 28320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:53.822515 28332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.822517 28327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:53.822525 28326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:53.822688 28320 server_base.cc:1034] running on GCE node
I20260807 02:20:53.823321 28320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:53.823904 28320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:53.825070 28320 hybrid_clock.cc:648] HybridClock initialized: now 1786069253825056 us; error 34 us; skew 500 ppm
I20260807 02:20:53.827147 28320 webserver.cc:460] Webserver started at http://127.1.126.195:43287/ using document root <none> and password file <none>
I20260807 02:20:53.827734 28320 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:53.827800 28320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:53.828042 28320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:53.830068 28320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "276ed251037b4eba82718ede578696a4"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "05a337b0e05936b8c137630f279ac285"
server_key_iv: "f53f012f5af18935ffb4b56306400f74"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.830647 28320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "276ed251037b4eba82718ede578696a4"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "05a337b0e05936b8c137630f279ac285"
server_key_iv: "f53f012f5af18935ffb4b56306400f74"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.834430 28320 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:20:53.836952 28342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.838136 28320 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:53.838233 28320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "276ed251037b4eba82718ede578696a4"
format_stamp: "Formatted at 2026-08-07 02:20:53 on dist-test-slave-39l8"
server_key: "05a337b0e05936b8c137630f279ac285"
server_key_iv: "f53f012f5af18935ffb4b56306400f74"
server_key_version: "encryptionkey@0"
I20260807 02:20:53.838315 28320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:53.868224 28320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:53.868880 28320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:53.869031 28320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:53.869577 28320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:53.870507 28320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:53.870558 28320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.870597 28320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:53.870621 28320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:53.879599 28320 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:39563
I20260807 02:20:53.879637 28492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:39563 every 8 connection(s)
I20260807 02:20:53.880519 28320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:53.882495 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 28320
I20260807 02:20:53.882623 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:20:53.882958 1531 external_mini_cluster.cc:1428] Setting key 2f891d9aca731c92eb1d49250db0e8af
I20260807 02:20:53.889676 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.882377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:59059 (local address 127.1.126.254:43997)
0807 02:20:53.882569 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.882574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.883744 (+ 1170us) server_negotiation.cc:407] Connection header received
0807 02:20:53.885279 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.885282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.885328 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.885394 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:53.886218 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.886759 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.887917 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.888133 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.888209 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.889251 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:53.889254 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:53.889256 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:53.889269 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:53.889288 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:53.889296 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:53.889356 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.889498 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.889549 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 02:20:53.890479 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.882874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:43997 (local address 127.1.126.195:59059)
0807 02:20:53.883596 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.883636 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.885050 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.885534 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.885540 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.885620 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:53.886099 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.886111 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.886873 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.886876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.887802 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.887812 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.888261 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.888264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.888410 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.888994 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:53.888996 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:53.889041 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:53.889107 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:53.889372 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:53.889379 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:53.889383 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.889479 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.889707 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":158,"threads_started":1}
I20260807 02:20:53.891665 28493 heartbeater.cc:347] Connected to a master server at 127.1.126.254:43997
I20260807 02:20:53.891906 28493 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:53.892427 28493 heartbeater.cc:511] Master 127.1.126.254:43997 requested a full tablet report, sending...
I20260807 02:20:53.893468 27892 ts_manager.cc:194] Registered new tserver with Master: 276ed251037b4eba82718ede578696a4 (127.1.126.195:39563)
I20260807 02:20:53.894093 27892 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.195:59059
I20260807 02:20:53.896967 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:53.903396 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.898968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53768 (local address 127.1.126.254:43997)
0807 02:20:53.899110 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.899115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.899334 (+ 219us) server_negotiation.cc:407] Connection header received
0807 02:20:53.899429 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.899431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.899469 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.899539 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:53.899802 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.900387 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.901657 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.901943 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.902023 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.902857 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:53.902860 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:53.902862 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:53.902874 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:53.902910 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:53.902925 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:53.903057 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.903197 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.903231 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 02:20:53.906020 27892 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:53.909013 27892 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:53.923996 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.917447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39563 (local address 127.0.0.1:40320)
0807 02:20:53.918697 (+ 1250us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.918775 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.918938 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.919428 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.919434 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.919457 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.919603 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.919614 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.921016 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.921020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.922591 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.922603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.923432 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.923435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.923555 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.923592 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.923715 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.923838 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"mutex_wait_us":58,"thread_start_us":114,"threads_started":1}
I20260807 02:20:53.924000 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.917658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40320 (local address 127.1.126.195:39563)
0807 02:20:53.918177 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.918192 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.918862 (+ 670us) server_negotiation.cc:407] Connection header received
0807 02:20:53.919097 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.919111 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.919273 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.919430 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.919725 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.920898 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.922764 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.923299 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.923428 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.923637 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.923744 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.923837 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":126,"threads_started":1}
I20260807 02:20:53.924714 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.917672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37454 (local address 127.1.126.194:33957)
0807 02:20:53.918270 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.918287 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.918564 (+ 277us) server_negotiation.cc:407] Connection header received
0807 02:20:53.919127 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.919132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.919310 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.919461 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.919992 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.921105 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.922753 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.923514 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.923606 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.923792 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.924443 (+ 651us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.924538 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":125,"threads_started":1}
I20260807 02:20:53.925094 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.918182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40949 (local address 127.0.0.1:44238)
0807 02:20:53.918857 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.918877 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.918944 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.919612 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.919615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.919643 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.919856 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.919861 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.922279 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.922286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.923384 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.923395 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.924673 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.924677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.924776 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.924811 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.924883 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.924950 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":70,"spinlock_wait_cycles":9856,"thread_start_us":86,"threads_started":1}
I20260807 02:20:53.925344 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.917382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33957 (local address 127.0.0.1:37454)
0807 02:20:53.918433 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.918480 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.918623 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.919621 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.919623 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.919648 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.919853 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.919860 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.921223 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.921226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.922594 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.922603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.923857 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.923861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.923946 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.923969 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.925058 (+ 1089us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.925132 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":157,"spinlock_wait_cycles":3200,"thread_start_us":87,"threads_started":1}
I20260807 02:20:53.925570 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.918545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44238 (local address 127.1.126.193:40949)
0807 02:20:53.918994 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.919007 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.919030 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:20:53.919108 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.919121 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.919310 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.919461 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.921252 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.922163 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.923539 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.924340 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.924439 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.924604 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.925283 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.925388 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":102,"threads_started":1}
I20260807 02:20:53.927408 28402 tablet_service.cc:1467] Processing CreateTablet for tablet c22f3cc2019b4c4e851763879659c918 (DEFAULT_TABLE table=test-table [id=bc866385f0f648f9a33f1f73be7846d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:53.927903 28056 tablet_service.cc:1467] Processing CreateTablet for tablet c22f3cc2019b4c4e851763879659c918 (DEFAULT_TABLE table=test-table [id=bc866385f0f648f9a33f1f73be7846d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:53.928118 28227 tablet_service.cc:1467] Processing CreateTablet for tablet c22f3cc2019b4c4e851763879659c918 (DEFAULT_TABLE table=test-table [id=bc866385f0f648f9a33f1f73be7846d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:53.928591 28402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c22f3cc2019b4c4e851763879659c918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:53.928941 28056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c22f3cc2019b4c4e851763879659c918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:53.929064 28227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c22f3cc2019b4c4e851763879659c918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:53.934933 28517 tablet_bootstrap.cc:492] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Bootstrap starting.
I20260807 02:20:53.936517 28521 tablet_bootstrap.cc:492] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Bootstrap starting.
I20260807 02:20:53.937228 28517 tablet_bootstrap.cc:654] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:53.937958 28517 log.cc:824] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:53.938305 28521 tablet_bootstrap.cc:654] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:53.938747 28518 tablet_bootstrap.cc:492] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Bootstrap starting.
I20260807 02:20:53.939211 28521 log.cc:824] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:53.940219 28517 tablet_bootstrap.cc:492] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: No bootstrap required, opened a new log
I20260807 02:20:53.940419 28517 ts_tablet_manager.cc:1397] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:20:53.940896 28518 tablet_bootstrap.cc:654] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:53.941180 28521 tablet_bootstrap.cc:492] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: No bootstrap required, opened a new log
I20260807 02:20:53.941376 28521 ts_tablet_manager.cc:1397] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:20:53.941749 28518 log.cc:824] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:53.945187 28518 tablet_bootstrap.cc:492] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: No bootstrap required, opened a new log
I20260807 02:20:53.945380 28518 ts_tablet_manager.cc:1397] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260807 02:20:53.945808 28521 raft_consensus.cc:348] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.946064 28521 raft_consensus.cc:374] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:53.946134 28521 raft_consensus.cc:729] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276ed251037b4eba82718ede578696a4, State: Initialized, Role: FOLLOWER
I20260807 02:20:53.946642 28521 consensus_queue.cc:260] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.947070 28517 raft_consensus.cc:348] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.947326 28517 raft_consensus.cc:374] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:53.947400 28517 raft_consensus.cc:729] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c2909f0e43402a9b70347de52d5925, State: Initialized, Role: FOLLOWER
I20260807 02:20:53.947755 28521 ts_tablet_manager.cc:1428] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 02:20:53.947839 28517 consensus_queue.cc:260] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.948165 28493 heartbeater.cc:503] Master 127.1.126.254:43997 was elected leader, sending a full tablet report...
I20260807 02:20:53.948563 28137 heartbeater.cc:503] Master 127.1.126.254:43997 was elected leader, sending a full tablet report...
I20260807 02:20:53.948819 28517 ts_tablet_manager.cc:1428] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 02:20:53.949709 28518 raft_consensus.cc:348] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.949930 28518 raft_consensus.cc:374] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:53.949996 28518 raft_consensus.cc:729] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf5b22710734cd7b02dba767db1a90f, State: Initialized, Role: FOLLOWER
I20260807 02:20:53.950393 28518 consensus_queue.cc:260] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.951062 28317 heartbeater.cc:503] Master 127.1.126.254:43997 was elected leader, sending a full tablet report...
I20260807 02:20:53.951293 28518 ts_tablet_manager.cc:1428] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 02:20:53.959604 28528 raft_consensus.cc:482] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:53.959798 28528 raft_consensus.cc:504] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.960892 28528 leader_election.cc:288] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 276ed251037b4eba82718ede578696a4 (127.1.126.195:39563), 47c2909f0e43402a9b70347de52d5925 (127.1.126.193:40949)
I20260807 02:20:53.961750 28525 raft_consensus.cc:482] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:53.961905 28525 raft_consensus.cc:504] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.963682 28525 leader_election.cc:288] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cf5b22710734cd7b02dba767db1a90f (127.1.126.194:33957), 47c2909f0e43402a9b70347de52d5925 (127.1.126.193:40949)
I20260807 02:20:53.965281 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.961119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:39563 (local address 127.1.126.194:58877)
0807 02:20:53.961237 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.961267 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.961355 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.961638 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.961642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.961666 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.961798 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.961807 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.962688 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.962693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.963912 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.963921 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.964854 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.964857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.964983 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.965007 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.965078 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.965149 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":28}
I20260807 02:20:53.965660 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.961229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:58877 (local address 127.1.126.195:39563)
0807 02:20:53.961363 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.961370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.961389 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:20:53.961447 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.961451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.961496 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.961623 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.961932 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.962574 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.964036 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.964623 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.964729 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.964791 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.965429 (+ 638us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.965527 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:20:53.966136 28432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22f3cc2019b4c4e851763879659c918" candidate_uuid: "2cf5b22710734cd7b02dba767db1a90f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276ed251037b4eba82718ede578696a4" is_pre_election: true
I20260807 02:20:53.966344 28432 raft_consensus.cc:2454] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cf5b22710734cd7b02dba767db1a90f in term 0.
I20260807 02:20:53.966856 28172 leader_election.cc:302] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276ed251037b4eba82718ede578696a4, 2cf5b22710734cd7b02dba767db1a90f; no voters:
I20260807 02:20:53.966965 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.961230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:39269 (local address 127.1.126.193:40949)
0807 02:20:53.961359 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.961364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.961710 (+ 346us) server_negotiation.cc:407] Connection header received
0807 02:20:53.961892 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.961895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.961947 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.962030 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.962316 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.963059 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.964568 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.965202 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.965289 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.965360 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.966737 (+ 1377us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.966844 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":50}
I20260807 02:20:53.967173 28528 raft_consensus.cc:2781] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:53.967269 28528 raft_consensus.cc:482] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:53.967327 28528 raft_consensus.cc:3037] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:53.967978 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.964111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:36205 (local address 127.1.126.194:33957)
0807 02:20:53.964217 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.964221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.964233 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:20:53.964275 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.964277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.964315 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.964380 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.964730 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.965424 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.966881 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.967431 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.967572 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.967613 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.967810 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.967872 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":50}
I20260807 02:20:53.967978 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.963175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33957 (local address 127.1.126.195:36205)
0807 02:20:53.963420 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.963432 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.963500 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.964469 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.964472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.964489 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.964587 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.964593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.965662 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.965667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.966738 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.966749 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.967573 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.967576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.967676 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.967702 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.967791 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.967859 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260807 02:20:53.968513 28256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22f3cc2019b4c4e851763879659c918" candidate_uuid: "276ed251037b4eba82718ede578696a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf5b22710734cd7b02dba767db1a90f" is_pre_election: true
I20260807 02:20:53.968631 28528 raft_consensus.cc:504] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.968881 28256 raft_consensus.cc:2379] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 276ed251037b4eba82718ede578696a4 in current term 1: Already voted for candidate 2cf5b22710734cd7b02dba767db1a90f in this term.
I20260807 02:20:53.969219 28528 leader_election.cc:288] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [CANDIDATE]: Term 1 election: Requested vote from peers 276ed251037b4eba82718ede578696a4 (127.1.126.195:39563), 47c2909f0e43402a9b70347de52d5925 (127.1.126.193:40949)
I20260807 02:20:53.966917 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.961138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40949 (local address 127.1.126.194:39269)
0807 02:20:53.961620 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.961640 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.961771 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.962057 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.962060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.962079 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.962193 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.962199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.963187 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.963191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.964443 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.964455 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.966230 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.966237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.966541 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.966581 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.966674 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.966767 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":164,"thread_start_us":112,"threads_started":1}
I20260807 02:20:53.969293 28432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22f3cc2019b4c4e851763879659c918" candidate_uuid: "2cf5b22710734cd7b02dba767db1a90f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276ed251037b4eba82718ede578696a4"
I20260807 02:20:53.969398 28432 raft_consensus.cc:3037] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:53.969843 28079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22f3cc2019b4c4e851763879659c918" candidate_uuid: "2cf5b22710734cd7b02dba767db1a90f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c2909f0e43402a9b70347de52d5925" is_pre_election: true
I20260807 02:20:53.969929 28078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22f3cc2019b4c4e851763879659c918" candidate_uuid: "2cf5b22710734cd7b02dba767db1a90f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c2909f0e43402a9b70347de52d5925"
I20260807 02:20:53.970093 28079 raft_consensus.cc:2454] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cf5b22710734cd7b02dba767db1a90f in term 0.
I20260807 02:20:53.970619 28432 raft_consensus.cc:2454] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cf5b22710734cd7b02dba767db1a90f in term 1.
I20260807 02:20:53.970954 28172 leader_election.cc:302] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 276ed251037b4eba82718ede578696a4, 2cf5b22710734cd7b02dba767db1a90f; no voters: 47c2909f0e43402a9b70347de52d5925
I20260807 02:20:53.971165 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.963185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40949 (local address 127.1.126.195:59943)
0807 02:20:53.963723 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:53.963735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:53.963810 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:53.964213 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:53.964216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:53.964233 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:53.964349 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.964354 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.965390 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.965394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.968029 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:53.968049 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.969078 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.969083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:53.969188 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.970833 (+ 1645us) client_negotiation.cc:769] Sending connection context
0807 02:20:53.970931 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 02:20:53.971003 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":267,"thread_start_us":92,"threads_started":1}
I20260807 02:20:53.971200 28528 raft_consensus.cc:2781] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:53.971235 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.963321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:59943 (local address 127.1.126.193:40949)
0807 02:20:53.963927 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.963931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.963944 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:20:53.963983 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.963986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.964022 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.964099 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:53.964468 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.965268 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.968196 (+ 2928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.968825 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.968941 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.968993 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.970965 (+ 1972us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.971084 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":541,"thread_start_us":80,"threads_started":1}
I20260807 02:20:53.971583 28078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c22f3cc2019b4c4e851763879659c918" candidate_uuid: "276ed251037b4eba82718ede578696a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c2909f0e43402a9b70347de52d5925" is_pre_election: true
I20260807 02:20:53.971624 28528 raft_consensus.cc:686] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 1 LEADER]: Becoming Leader. State: Replica: 2cf5b22710734cd7b02dba767db1a90f, State: Running, Role: LEADER
I20260807 02:20:53.971720 28078 raft_consensus.cc:2454] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276ed251037b4eba82718ede578696a4 in term 0.
I20260807 02:20:53.971933 28528 consensus_queue.cc:237] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } }
I20260807 02:20:53.971989 28348 leader_election.cc:302] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 276ed251037b4eba82718ede578696a4, 47c2909f0e43402a9b70347de52d5925; no voters: 2cf5b22710734cd7b02dba767db1a90f
I20260807 02:20:53.972282 28525 raft_consensus.cc:2741] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 02:20:53.975095 27883 catalog_manager.cc:5495] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cf5b22710734cd7b02dba767db1a90f (127.1.126.194). New cstate: current_term: 1 leader_uuid: "2cf5b22710734cd7b02dba767db1a90f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cf5b22710734cd7b02dba767db1a90f" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 } health_report { overall_health: UNKNOWN } } }
I20260807 02:20:53.987314 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:53.983702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37462 (local address 127.1.126.194:33957)
0807 02:20:53.983842 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:53.983849 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:53.983864 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:20:53.984032 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:53.984035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:53.984085 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:53.984192 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:53.984453 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.984937 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.985800 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:53.986025 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:53.986137 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:53.986430 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:53.986898 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:53.987049 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:53.987148 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 02:20:53.987180 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:20:53.993309 28078 raft_consensus.cc:3037] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:53.993484 28432 raft_consensus.cc:1261] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 1 FOLLOWER]: Refusing update from remote peer 2cf5b22710734cd7b02dba767db1a90f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:53.994146 28528 consensus_queue.cc:1035] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [LEADER]: Connected to new peer: Peer: permanent_uuid: "276ed251037b4eba82718ede578696a4" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:53.994794 28078 raft_consensus.cc:1261] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 1 FOLLOWER]: Refusing update from remote peer 2cf5b22710734cd7b02dba767db1a90f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:53.995362 28528 consensus_queue.cc:1035] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c2909f0e43402a9b70347de52d5925" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 40949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 02:20:53.996811 28138 tablet.cc:2369] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:54.003705 28537 mvcc.cc:205] Tried to move back new op lower bound from 7315739664350212096 to 7315739664271978496. Current Snapshot: MvccSnapshot[applied={T|T < 7315739664350212096}]
I20260807 02:20:54.005486 28538 mvcc.cc:205] Tried to move back new op lower bound from 7315739664350212096 to 7315739664271978496. Current Snapshot: MvccSnapshot[applied={T|T < 7315739664350212096}]
I20260807 02:20:54.011781 27892 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:54.011978 27892 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:54.015218 27892 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd440e81be6e4620943148ade8326c00: Sending DeleteTablet for 3 replicas of tablet c22f3cc2019b4c4e851763879659c918
I20260807 02:20:54.016511 28402 tablet_service.cc:1514] Processing DeleteTablet for tablet c22f3cc2019b4c4e851763879659c918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:54 UTC) from {username='slave'} at 127.0.0.1:40320
I20260807 02:20:54.017117 28549 tablet_replica.cc:330] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: stopping tablet replica
I20260807 02:20:54.017213 28056 tablet_service.cc:1514] Processing DeleteTablet for tablet c22f3cc2019b4c4e851763879659c918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:54 UTC) from {username='slave'} at 127.0.0.1:44238
I20260807 02:20:54.017619 28549 raft_consensus.cc:2229] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:54.017848 28227 tablet_service.cc:1514] Processing DeleteTablet for tablet c22f3cc2019b4c4e851763879659c918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:54 UTC) from {username='slave'} at 127.0.0.1:37454
I20260807 02:20:54.018081 28549 raft_consensus.cc:2258] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:54.018332 28550 tablet_replica.cc:330] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: stopping tablet replica
I20260807 02:20:54.018630 28550 raft_consensus.cc:2229] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:54.018940 28550 raft_consensus.cc:2258] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:54.019326 28551 tablet_replica.cc:330] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: stopping tablet replica
I20260807 02:20:54.019791 28551 raft_consensus.cc:2229] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:20:54.020211 28551 raft_consensus.cc:2258] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:54.022953 28550 ts_tablet_manager.cc:1905] T c22f3cc2019b4c4e851763879659c918 P 47c2909f0e43402a9b70347de52d5925: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:54.020522 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 27970
I20260807 02:20:54.025795 28551 ts_tablet_manager.cc:1905] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:54.029644 28551 ts_tablet_manager.cc:1918] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:54.029779 28551 log.cc:1196] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/c22f3cc2019b4c4e851763879659c918
I20260807 02:20:54.030200 28551 ts_tablet_manager.cc:1939] T c22f3cc2019b4c4e851763879659c918 P 2cf5b22710734cd7b02dba767db1a90f: Deleting consensus metadata
I20260807 02:20:54.031433 28549 ts_tablet_manager.cc:1905] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:54.031569 27865 catalog_manager.cc:4841] TS 2cf5b22710734cd7b02dba767db1a90f (127.1.126.194:33957): tablet c22f3cc2019b4c4e851763879659c918 (table test-table [id=bc866385f0f648f9a33f1f73be7846d0]) successfully deleted
I20260807 02:20:54.033630 28549 ts_tablet_manager.cc:1918] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:54.033761 28549 log.cc:1196] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/c22f3cc2019b4c4e851763879659c918
I20260807 02:20:54.034075 28549 ts_tablet_manager.cc:1939] T c22f3cc2019b4c4e851763879659c918 P 276ed251037b4eba82718ede578696a4: Deleting consensus metadata
I20260807 02:20:54.035270 27866 catalog_manager.cc:4841] TS 276ed251037b4eba82718ede578696a4 (127.1.126.195:39563): tablet c22f3cc2019b4c4e851763879659c918 (table test-table [id=bc866385f0f648f9a33f1f73be7846d0]) successfully deleted
W20260807 02:20:54.039180 27868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:40949 (error 108)
I20260807 02:20:54.040095 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 28144
I20260807 02:20:54.040391 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:54.040003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:40949 (local address 127.0.0.1:44242)
0807 02:20:54.040213 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:54.040297 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 02:20:54.042815 27868 catalog_manager.cc:4584] TS 47c2909f0e43402a9b70347de52d5925 (127.1.126.193:40949): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c22f3cc2019b4c4e851763879659c918: Network error: Client connection negotiation failed: client connection to 127.1.126.193:40949: connect: Connection refused (error 111)
I20260807 02:20:54.050700 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 28320
I20260807 02:20:54.059795 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 27845
2026-08-07T02:20:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1047 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:20:54 dist-test-slave-39l8 krb5kdc[28557](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:20:54 dist-test-slave-39l8 krb5kdc[28557](info): set up 2 sockets
Aug 07 02:20:54 dist-test-slave-39l8 krb5kdc[28557](info): commencing operation
krb5kdc: starting...
W20260807 02:20:55.282114 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:20:55 dist-test-slave-39l8 krb5kdc[28557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:20:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:20:55.412163 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:43733
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:43733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:55.526664 28572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:55.527060 28572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:55.527161 28572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:55.531162 28572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:55.531253 28572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:55.531293 28572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:55.531330 28572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:55.531364 28572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:55.536664 28572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:43733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:43733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:55.537744 28572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:55.538810 28572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:55.547422 28581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:55.547592 28572 server_base.cc:1034] running on GCE node
W20260807 02:20:55.547502 28578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:55.547405 28579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:55.548278 28572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:55.549394 28572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:55.550581 28572 hybrid_clock.cc:648] HybridClock initialized: now 1786069255550552 us; error 43 us; skew 500 ppm
Aug 07 02:20:55 dist-test-slave-39l8 krb5kdc[28557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069255, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:55.555289 28572 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:20:55.556267 28572 webserver.cc:460] Webserver started at http://127.1.126.254:46359/ using document root <none> and password file <none>
I20260807 02:20:55.556890 28572 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:55.556986 28572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:55.557236 28572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:55.559496 28572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "47805ad210074720a655058816b19d7b"
format_stamp: "Formatted at 2026-08-07 02:20:55 on dist-test-slave-39l8"
server_key: "888953d6762d05806d293521e0f0448e"
server_key_iv: "22aa134ac79bff35bbd46293501d8f2c"
server_key_version: "encryptionkey@0"
I20260807 02:20:55.560072 28572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "47805ad210074720a655058816b19d7b"
format_stamp: "Formatted at 2026-08-07 02:20:55 on dist-test-slave-39l8"
server_key: "888953d6762d05806d293521e0f0448e"
server_key_iv: "22aa134ac79bff35bbd46293501d8f2c"
server_key_version: "encryptionkey@0"
I20260807 02:20:55.563913 28572 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 02:20:55.566460 28594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:55.567781 28572 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:20:55.567948 28572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "47805ad210074720a655058816b19d7b"
format_stamp: "Formatted at 2026-08-07 02:20:55 on dist-test-slave-39l8"
server_key: "888953d6762d05806d293521e0f0448e"
server_key_iv: "22aa134ac79bff35bbd46293501d8f2c"
server_key_version: "encryptionkey@0"
I20260807 02:20:55.568068 28572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:55.593672 28572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:55.598240 28572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:55.598459 28572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:55.610965 28572 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:43733
I20260807 02:20:55.611106 28671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:43733 every 8 connection(s)
I20260807 02:20:55.612046 28572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:55.612335 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 28572
I20260807 02:20:55.612491 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:55.612884 1531 external_mini_cluster.cc:1428] Setting key a2a379fc5c072faa47031f0bcada6ea4
I20260807 02:20:55.615496 28672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:55.621905 28672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b: Bootstrap starting.
I20260807 02:20:55.625051 28672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b: Neither blocks nor log segments found. Creating new log.
Aug 07 02:20:55 dist-test-slave-39l8 krb5kdc[28557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:55.625952 28672 log.cc:824] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:55.628448 28672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b: No bootstrap required, opened a new log
I20260807 02:20:55.631322 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:55.614902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50286 (local address 127.1.126.254:43733)
0807 02:20:55.615408 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:55.615432 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:55.615484 (+ 52us) server_negotiation.cc:407] Connection header received
0807 02:20:55.616630 (+ 1146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:55.616661 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:55.617152 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:55.617574 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:55.618518 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:55.620409 (+ 1891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:55.621651 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:55.622538 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:55.623304 (+ 766us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:55.626220 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:55.626226 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:55.626244 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:55.626275 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:55.628306 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:55.628823 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:55.628829 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:55.628835 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:55.628960 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:55.629278 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:55.629282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:55.629284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:55.629702 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:55.629903 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:55.630226 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 02:20:55.630527 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":145,"threads_started":1}
I20260807 02:20:55.632369 28672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47805ad210074720a655058816b19d7b" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43733 } }
I20260807 02:20:55.632630 28672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:55.632704 28672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47805ad210074720a655058816b19d7b, State: Initialized, Role: FOLLOWER
I20260807 02:20:55.633201 28672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47805ad210074720a655058816b19d7b" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43733 } }
I20260807 02:20:55.633358 28672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:55.633430 28672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:55.633545 28672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:55.634500 28672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47805ad210074720a655058816b19d7b" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43733 } }
I20260807 02:20:55.634943 28672 leader_election.cc:302] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47805ad210074720a655058816b19d7b; no voters:
I20260807 02:20:55.635293 28672 leader_election.cc:288] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:55.635397 28679 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:55.635640 28679 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [term 1 LEADER]: Becoming Leader. State: Replica: 47805ad210074720a655058816b19d7b, State: Running, Role: LEADER
I20260807 02:20:55.635933 28679 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47805ad210074720a655058816b19d7b" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43733 } }
I20260807 02:20:55.636667 28672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:55.637732 28680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47805ad210074720a655058816b19d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47805ad210074720a655058816b19d7b" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43733 } } }
I20260807 02:20:55.637861 28680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:55.638260 28691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:55.638226 28681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47805ad210074720a655058816b19d7b. Latest consensus state: current_term: 1 leader_uuid: "47805ad210074720a655058816b19d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47805ad210074720a655058816b19d7b" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 43733 } } }
I20260807 02:20:55.638446 28681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:55.641424 28691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:55.647396 28691 catalog_manager.cc:1347] Generated new cluster ID: 5faecb4744b4480b9a4cab9cd08ecc69
I20260807 02:20:55.647485 28691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:55.675171 28691 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:55.676414 28691 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:55.681588 28691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b: Generated new TSK 0
I20260807 02:20:55.682317 28691 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.126.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
Entry for principal kudu/127.1.126.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab.
I20260807 02:20:55.718302 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43733
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:55.860399 28707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:55.860657 28707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:55.860704 28707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:55.864655 28707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:55.864713 28707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:55.864768 28707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:55.869937 28707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.193.keytab
--principal=kudu/127.1.126.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:55.870949 28707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:55.871935 28707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:55.881954 28716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:55.881939 28713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:55.881939 28714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:55.882225 28707 server_base.cc:1034] running on GCE node
I20260807 02:20:55.882682 28707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:55.883333 28707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:55.884521 28707 hybrid_clock.cc:648] HybridClock initialized: now 1786069255884502 us; error 30 us; skew 500 ppm
Aug 07 02:20:55 dist-test-slave-39l8 krb5kdc[28557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069255, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:55.887429 28707 init.cc:377] Logged in from keytab as kudu/127.1.126.193@KRBTEST.COM (short username kudu)
I20260807 02:20:55.888304 28707 webserver.cc:460] Webserver started at http://127.1.126.193:33895/ using document root <none> and password file <none>
I20260807 02:20:55.888830 28707 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:55.888888 28707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:55.889047 28707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:55.891124 28707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "b69a525dbee448a491ac949efc98f97e"
format_stamp: "Formatted at 2026-08-07 02:20:55 on dist-test-slave-39l8"
server_key: "1c538241433d538fc22eb41302f90a35"
server_key_iv: "279906b2f17b1df0d127a7dbf57576fb"
server_key_version: "encryptionkey@0"
I20260807 02:20:55.891631 28707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "b69a525dbee448a491ac949efc98f97e"
format_stamp: "Formatted at 2026-08-07 02:20:55 on dist-test-slave-39l8"
server_key: "1c538241433d538fc22eb41302f90a35"
server_key_iv: "279906b2f17b1df0d127a7dbf57576fb"
server_key_version: "encryptionkey@0"
I20260807 02:20:55.895285 28707 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:20:55.897701 28725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:55.899044 28707 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:55.899199 28707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "b69a525dbee448a491ac949efc98f97e"
format_stamp: "Formatted at 2026-08-07 02:20:55 on dist-test-slave-39l8"
server_key: "1c538241433d538fc22eb41302f90a35"
server_key_iv: "279906b2f17b1df0d127a7dbf57576fb"
server_key_version: "encryptionkey@0"
I20260807 02:20:55.899300 28707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:55.917728 28707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:55.921162 28707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:55.921372 28707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:55.921981 28707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:55.922892 28707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:55.922940 28707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:55.923010 28707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:55.923041 28707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:55.931895 28707 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:35883
I20260807 02:20:55.931931 28871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:35883 every 8 connection(s)
I20260807 02:20:55.932814 28707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:55.937150 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 28707
I20260807 02:20:55.937310 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:20:55.937650 1531 external_mini_cluster.cc:1428] Setting key 3679a86b691779a5e8049e3928d3201f
Aug 07 02:20:55 dist-test-slave-39l8 krb5kdc[28557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069255, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.193@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:55.947052 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:55.934649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:42703 (local address 127.1.126.254:43733)
0807 02:20:55.934848 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:55.934851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:55.935647 (+ 796us) server_negotiation.cc:407] Connection header received
0807 02:20:55.936656 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:55.936659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:55.936719 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:55.936823 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:55.938324 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:55.939163 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:55.940300 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:55.940541 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:55.940654 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:55.943456 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:55.943460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:55.943463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:55.943492 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:55.944936 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:55.945450 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:55.945455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:55.945457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:55.945537 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:55.945892 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:55.945896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:55.945898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:55.946076 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:55.946190 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:55.946737 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 02:20:55.946873 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260807 02:20:55.947837 28874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:55.935044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:43733 (local address 127.1.126.193:42703)
0807 02:20:55.935494 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:55.935536 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:55.936440 (+ 904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:55.937036 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:55.937047 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:55.937559 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:55.938158 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:55.938181 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:55.939277 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:55.939281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:55.940154 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:55.940164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:55.940699 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:55.940703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:55.940868 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:55.941517 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:55.941550 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:55.943289 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:55.945060 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:55.945066 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:55.945081 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:55.945339 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:55.945642 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:55.945645 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:55.945647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:55.945790 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:55.946206 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:55.946214 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:55.946449 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 02:20:55.946657 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 02:20:55.947005 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
WARNING: no policy specified for kudu/127.1.126.194@KRBTEST.COM; defaulting to no policy
I20260807 02:20:55.949149 28872 heartbeater.cc:347] Connected to a master server at 127.1.126.254:43733
I20260807 02:20:55.949419 28872 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:55.950040 28872 heartbeater.cc:511] Master 127.1.126.254:43733 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.194@KRBTEST.COM" created.
I20260807 02:20:55.951964 28621 ts_manager.cc:194] Registered new tserver with Master: b69a525dbee448a491ac949efc98f97e (127.1.126.193:35883)
I20260807 02:20:55.953547 28621 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.193@KRBTEST.COM'} at 127.1.126.193:42703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
Entry for principal kudu/127.1.126.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab.
I20260807 02:20:55.970309 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43733
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:56.091741 28877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:56.092060 28877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:56.092154 28877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:56.096166 28877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:56.096266 28877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:56.096356 28877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:56.101606 28877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.194.keytab
--principal=kudu/127.1.126.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:56.102772 28877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:56.104082 28877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:56.114375 28887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:56.114337 28889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:56.114346 28886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:56.114558 28877 server_base.cc:1034] running on GCE node
I20260807 02:20:56.115027 28877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:56.115705 28877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:56.116904 28877 hybrid_clock.cc:648] HybridClock initialized: now 1786069256116875 us; error 46 us; skew 500 ppm
Aug 07 02:20:56 dist-test-slave-39l8 krb5kdc[28557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069256, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:56.119787 28877 init.cc:377] Logged in from keytab as kudu/127.1.126.194@KRBTEST.COM (short username kudu)
I20260807 02:20:56.120687 28877 webserver.cc:460] Webserver started at http://127.1.126.194:32875/ using document root <none> and password file <none>
I20260807 02:20:56.121287 28877 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:56.121384 28877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:56.121634 28877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:56.123821 28877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "8eeb4f121c1049a1982d2436f318ac83"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "99ec75ab6bdf1c8c308ba408c9db6449"
server_key_iv: "e588beef3c0df9a379577f8022a1a292"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.124389 28877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "8eeb4f121c1049a1982d2436f318ac83"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "99ec75ab6bdf1c8c308ba408c9db6449"
server_key_iv: "e588beef3c0df9a379577f8022a1a292"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.128288 28877 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:20:56.130873 28898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.132089 28877 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:56.132233 28877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "8eeb4f121c1049a1982d2436f318ac83"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "99ec75ab6bdf1c8c308ba408c9db6449"
server_key_iv: "e588beef3c0df9a379577f8022a1a292"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.132344 28877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:56.145524 28877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:56.148267 28877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:56.148468 28877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:56.149036 28877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:56.149854 28877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:56.149927 28877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.149996 28877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:56.150050 28877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.159211 28877 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:33487
I20260807 02:20:56.159242 29056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:33487 every 8 connection(s)
I20260807 02:20:56.160092 28877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:56.168396 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 28877
I20260807 02:20:56.168537 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:20:56.168887 1531 external_mini_cluster.cc:1428] Setting key b3c65f8141f536a61aa18e22e3f14e63
Aug 07 02:20:56 dist-test-slave-39l8 krb5kdc[28557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069256, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.194@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:56.174437 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.161973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:53971 (local address 127.1.126.254:43733)
0807 02:20:56.162131 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.162135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.163010 (+ 875us) server_negotiation.cc:407] Connection header received
0807 02:20:56.163958 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.163963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.164024 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.164134 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:56.165293 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.165839 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.167072 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.167292 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.167409 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.170244 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:56.170250 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:56.170257 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:56.170283 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:56.172158 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:56.172759 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:56.172765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:56.172770 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:56.172877 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:56.173297 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:56.173302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:56.173303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:56.173497 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:56.173618 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.174146 (+ 528us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.174275 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:20:56.175343 29061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.162341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:43733 (local address 127.1.126.194:53971)
0807 02:20:56.162866 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.162908 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.163735 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.164314 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.164321 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.164670 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:56.165145 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.165159 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.165978 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.165982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.166928 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.166939 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.167451 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.167456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.167621 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.168261 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:56.168285 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:56.170010 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:56.172280 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:56.172285 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:56.172298 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:56.172622 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:56.173015 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:56.173021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:56.173023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:56.173189 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:56.173617 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:56.173633 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:56.173890 (+ 257us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.174091 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.174432 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
I20260807 02:20:56.176784 29057 heartbeater.cc:347] Connected to a master server at 127.1.126.254:43733
I20260807 02:20:56.177037 29057 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:56.177567 29057 heartbeater.cc:511] Master 127.1.126.254:43733 requested a full tablet report, sending...
I20260807 02:20:56.178781 28621 ts_manager.cc:194] Registered new tserver with Master: 8eeb4f121c1049a1982d2436f318ac83 (127.1.126.194:33487)
I20260807 02:20:56.179651 28621 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.194@KRBTEST.COM'} at 127.1.126.194:53971
WARNING: no policy specified for kudu/127.1.126.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
Entry for principal kudu/127.1.126.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab.
I20260807 02:20:56.198846 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43733
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:56.313923 29065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:56.314185 29065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:56.314266 29065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:56.318331 29065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:56.318393 29065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:56.318501 29065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:56.323992 29065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.195.keytab
--principal=kudu/127.1.126.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:43733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:56.325181 29065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:56.326296 29065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:56.337064 29072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:56.337028 29077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:56.337051 29065 server_base.cc:1034] running on GCE node
W20260807 02:20:56.337149 29073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:56.337848 29065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:56.338634 29065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:56.339798 29065 hybrid_clock.cc:648] HybridClock initialized: now 1786069256339782 us; error 26 us; skew 500 ppm
Aug 07 02:20:56 dist-test-slave-39l8 krb5kdc[28557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069256, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:56.342559 29065 init.cc:377] Logged in from keytab as kudu/127.1.126.195@KRBTEST.COM (short username kudu)
I20260807 02:20:56.343581 29065 webserver.cc:460] Webserver started at http://127.1.126.195:37933/ using document root <none> and password file <none>
I20260807 02:20:56.344208 29065 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:56.344307 29065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:56.344611 29065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:56.346804 29065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "24bef2ea17a4481bbe076f9611baa547"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "0bbcaed3e1a78eaab6ad4000b2366fc1"
server_key_iv: "d987eeb7f33f631a99be3f8441094d9a"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.347353 29065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "24bef2ea17a4481bbe076f9611baa547"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "0bbcaed3e1a78eaab6ad4000b2366fc1"
server_key_iv: "d987eeb7f33f631a99be3f8441094d9a"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.351131 29065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:20:56.353585 29087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.354930 29065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:56.355072 29065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "24bef2ea17a4481bbe076f9611baa547"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "0bbcaed3e1a78eaab6ad4000b2366fc1"
server_key_iv: "d987eeb7f33f631a99be3f8441094d9a"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.355199 29065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:56.381553 29065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:56.384591 29065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:56.384805 29065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:56.385463 29065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:56.386390 29065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:56.386462 29065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.386538 29065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:56.386580 29065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.395428 29065 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:38599
I20260807 02:20:56.395510 29239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:38599 every 8 connection(s)
I20260807 02:20:56.396374 29065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:56.405855 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 29065
I20260807 02:20:56.405992 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
Aug 07 02:20:56 dist-test-slave-39l8 krb5kdc[28557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069256, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.195@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:20:56.406320 1531 external_mini_cluster.cc:1428] Setting key 219684f9cb8da4809c876a2a981c45eb
I20260807 02:20:56.410523 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.398300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:55389 (local address 127.1.126.254:43733)
0807 02:20:56.398473 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.398478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.399351 (+ 873us) server_negotiation.cc:407] Connection header received
0807 02:20:56.400637 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.400640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.400689 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.400768 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:56.401891 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.402428 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.403859 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.404081 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.404172 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.406832 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:56.406835 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:56.406837 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:56.406862 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:56.408564 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:56.409153 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:56.409156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:56.409158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:56.409238 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:56.409542 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:56.409545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:56.409546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:56.409733 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:56.409819 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.410300 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.410402 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 02:20:56.411511 29243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.398677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:43733 (local address 127.1.126.195:55389)
0807 02:20:56.399199 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.399242 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.400399 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.400933 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.400939 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.401301 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:56.401764 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.401777 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.402562 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.402570 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.403733 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.403746 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.404246 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.404250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.404383 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.405007 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:20:56.405023 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:56.406600 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:56.408698 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:56.408704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:56.408726 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:56.409045 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:56.409316 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:20:56.409319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:20:56.409320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:20:56.409455 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:20:56.409839 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:56.409844 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:56.410076 (+ 232us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.410236 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.410492 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":115,"threads_started":1}
I20260807 02:20:56.412765 29240 heartbeater.cc:347] Connected to a master server at 127.1.126.254:43733
I20260807 02:20:56.413021 29240 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:56.413548 29240 heartbeater.cc:511] Master 127.1.126.254:43733 requested a full tablet report, sending...
I20260807 02:20:56.414590 28621 ts_manager.cc:194] Registered new tserver with Master: 24bef2ea17a4481bbe076f9611baa547 (127.1.126.195:38599)
I20260807 02:20:56.415211 28621 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.126.195@KRBTEST.COM'} at 127.1.126.195:55389
I20260807 02:20:56.420501 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:56.430155 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.422574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50302 (local address 127.1.126.254:43733)
0807 02:20:56.422765 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.422772 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.422928 (+ 156us) server_negotiation.cc:407] Connection header received
0807 02:20:56.423033 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.423036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.423077 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.423150 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:56.423865 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.424382 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.425218 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.425425 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.425502 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.426974 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:56.426977 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:56.426979 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:56.427001 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:56.428488 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:56.428930 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:56.428933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:56.428934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:56.429008 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:56.429257 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:56.429259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:56.429260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:56.429465 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:56.429570 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.429843 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.429943 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:20:56.433334 28621 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:56.436789 28621 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:56.451665 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.445718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42674 (local address 127.1.126.194:33487)
0807 02:20:56.446063 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.446075 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.446101 (+ 26us) server_negotiation.cc:407] Connection header received
0807 02:20:56.446258 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.446267 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.446498 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.447091 (+ 593us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:56.447286 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.448428 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.450088 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.450955 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.451078 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.451228 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.451418 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.451509 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":155,"threads_started":1}
I20260807 02:20:56.451654 29255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.445575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33487 (local address 127.0.0.1:42674)
0807 02:20:56.445912 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.445957 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.446073 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.446740 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.446746 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.446774 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:56.446917 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.446924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.448581 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.448585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.449949 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.449960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.451082 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.451086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.451199 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.451237 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.451385 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.451506 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":4,"thread_start_us":104,"threads_started":1}
I20260807 02:20:56.452117 29261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.446665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:38599 (local address 127.0.0.1:42728)
0807 02:20:56.446936 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.446950 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.447033 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.447844 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.447847 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.447865 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:56.447968 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.447974 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.449505 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.449508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.450647 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.450658 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.451684 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.451688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.451833 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.451860 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.451926 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.451994 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":26,"thread_start_us":101,"threads_started":1}
I20260807 02:20:56.452641 29257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.446327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35883 (local address 127.0.0.1:52526)
0807 02:20:56.446555 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.446571 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.446664 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.447970 (+ 1306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.447975 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.448002 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:56.448117 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.448125 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.449511 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.449514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.450549 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.450559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.451684 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.451688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.452342 (+ 654us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.452362 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.452448 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.452517 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":597,"thread_start_us":99,"threads_started":1}
I20260807 02:20:56.452777 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.446524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52526 (local address 127.1.126.193:35883)
0807 02:20:56.447476 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.447489 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.447508 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:20:56.447572 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.447575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.447785 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.448317 (+ 532us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:56.448501 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.449353 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.450686 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.451519 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.451822 (+ 303us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.451976 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.452495 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.452618 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":844,"thread_start_us":115,"threads_started":1}
I20260807 02:20:56.453671 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.447016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42728 (local address 127.1.126.195:38599)
0807 02:20:56.447390 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.447407 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.447428 (+ 21us) server_negotiation.cc:407] Connection header received
0807 02:20:56.447502 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.447507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.447687 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.448121 (+ 434us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:56.448259 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.449348 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.450800 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.451551 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.453250 (+ 1699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.453408 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.453460 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.453553 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":150,"threads_started":1}
I20260807 02:20:56.455201 28962 tablet_service.cc:1467] Processing CreateTablet for tablet b0259491de6f4efaba5f481580357c1d (DEFAULT_TABLE table=test-table [id=14074d201b2b4b5898f49b9ebbb30590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:56.455614 28788 tablet_service.cc:1467] Processing CreateTablet for tablet b0259491de6f4efaba5f481580357c1d (DEFAULT_TABLE table=test-table [id=14074d201b2b4b5898f49b9ebbb30590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:56.455780 29148 tablet_service.cc:1467] Processing CreateTablet for tablet b0259491de6f4efaba5f481580357c1d (DEFAULT_TABLE table=test-table [id=14074d201b2b4b5898f49b9ebbb30590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:56.456401 28962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0259491de6f4efaba5f481580357c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:56.456563 28788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0259491de6f4efaba5f481580357c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:56.456831 29148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0259491de6f4efaba5f481580357c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:56.463236 29263 tablet_bootstrap.cc:492] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Bootstrap starting.
I20260807 02:20:56.464352 29266 tablet_bootstrap.cc:492] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: Bootstrap starting.
I20260807 02:20:56.465556 29263 tablet_bootstrap.cc:654] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:56.466037 29266 tablet_bootstrap.cc:654] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:56.466642 29263 log.cc:824] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:56.466744 29266 log.cc:824] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:56.467496 29267 tablet_bootstrap.cc:492] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Bootstrap starting.
I20260807 02:20:56.468544 29263 tablet_bootstrap.cc:492] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: No bootstrap required, opened a new log
I20260807 02:20:56.468746 29263 ts_tablet_manager.cc:1397] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260807 02:20:56.469197 29267 tablet_bootstrap.cc:654] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:56.470142 29267 log.cc:824] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:56.471793 29266 tablet_bootstrap.cc:492] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: No bootstrap required, opened a new log
I20260807 02:20:56.471988 29266 ts_tablet_manager.cc:1397] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260807 02:20:56.472076 29267 tablet_bootstrap.cc:492] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: No bootstrap required, opened a new log
I20260807 02:20:56.472277 29267 ts_tablet_manager.cc:1397] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 02:20:56.472090 29263 raft_consensus.cc:348] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.472380 29263 raft_consensus.cc:374] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:56.472440 29263 raft_consensus.cc:729] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24bef2ea17a4481bbe076f9611baa547, State: Initialized, Role: FOLLOWER
I20260807 02:20:56.472913 29263 consensus_queue.cc:260] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.473641 29240 heartbeater.cc:503] Master 127.1.126.254:43733 was elected leader, sending a full tablet report...
I20260807 02:20:56.473951 29263 ts_tablet_manager.cc:1428] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 02:20:56.476071 29266 raft_consensus.cc:348] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.476307 29266 raft_consensus.cc:374] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:56.476395 29266 raft_consensus.cc:729] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b69a525dbee448a491ac949efc98f97e, State: Initialized, Role: FOLLOWER
I20260807 02:20:56.476742 29267 raft_consensus.cc:348] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.476871 29266 consensus_queue.cc:260] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.477039 29267 raft_consensus.cc:374] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:56.477104 29267 raft_consensus.cc:729] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eeb4f121c1049a1982d2436f318ac83, State: Initialized, Role: FOLLOWER
I20260807 02:20:56.477540 28872 heartbeater.cc:503] Master 127.1.126.254:43733 was elected leader, sending a full tablet report...
I20260807 02:20:56.477546 29267 consensus_queue.cc:260] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.478178 29057 heartbeater.cc:503] Master 127.1.126.254:43733 was elected leader, sending a full tablet report...
I20260807 02:20:56.478830 29267 ts_tablet_manager.cc:1428] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:20:56.479148 29266 ts_tablet_manager.cc:1428] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 02:20:56.482157 29272 raft_consensus.cc:482] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:56.482350 29272 raft_consensus.cc:504] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.483345 29272 leader_election.cc:288] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eeb4f121c1049a1982d2436f318ac83 (127.1.126.194:33487), 24bef2ea17a4481bbe076f9611baa547 (127.1.126.195:38599)
I20260807 02:20:56.487609 29274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.483574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:33487 (local address 127.1.126.193:48045)
0807 02:20:56.483882 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.483900 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.484005 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.484391 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.484396 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.484418 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:56.484551 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.484561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.485605 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.485609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.486423 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.486431 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.487160 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.487165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.487265 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.487289 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.487366 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.487420 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":1,"thread_start_us":115,"threads_started":1}
I20260807 02:20:56.487630 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.483649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:48045 (local address 127.1.126.194:33487)
0807 02:20:56.483775 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.483779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.483982 (+ 203us) server_negotiation.cc:407] Connection header received
0807 02:20:56.484102 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.484108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.484162 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.484244 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:56.484703 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.485489 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.486547 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.487042 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.487138 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.487206 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.487408 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.487497 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:20:56.487720 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.484083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:33787 (local address 127.1.126.195:38599)
0807 02:20:56.484237 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.484241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.484365 (+ 124us) server_negotiation.cc:407] Connection header received
0807 02:20:56.484431 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.484434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.484479 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.484565 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:56.484790 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.485500 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.486617 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.487119 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.487248 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.487298 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.487521 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.487595 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 02:20:56.487738 29275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.483987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:38599 (local address 127.1.126.193:33787)
0807 02:20:56.484276 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.484287 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:56.484365 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:56.484566 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:56.484568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:56.484578 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:56.484694 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.484699 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.485652 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.485655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.486459 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:56.486468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.487249 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.487253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:56.487381 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.487408 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 02:20:56.487482 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 02:20:56.487556 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":21,"thread_start_us":101,"threads_started":1}
I20260807 02:20:56.488644 28991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0259491de6f4efaba5f481580357c1d" candidate_uuid: "b69a525dbee448a491ac949efc98f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb4f121c1049a1982d2436f318ac83" is_pre_election: true
I20260807 02:20:56.488644 29176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0259491de6f4efaba5f481580357c1d" candidate_uuid: "b69a525dbee448a491ac949efc98f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24bef2ea17a4481bbe076f9611baa547" is_pre_election: true
I20260807 02:20:56.488938 28991 raft_consensus.cc:2454] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b69a525dbee448a491ac949efc98f97e in term 0.
I20260807 02:20:56.488938 29176 raft_consensus.cc:2454] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b69a525dbee448a491ac949efc98f97e in term 0.
I20260807 02:20:56.489404 28729 leader_election.cc:302] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eeb4f121c1049a1982d2436f318ac83, b69a525dbee448a491ac949efc98f97e; no voters:
I20260807 02:20:56.489682 29272 raft_consensus.cc:2781] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:56.489781 29272 raft_consensus.cc:482] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:56.489838 29272 raft_consensus.cc:3037] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:56.490949 29272 raft_consensus.cc:504] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.491277 29272 leader_election.cc:288] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [CANDIDATE]: Term 1 election: Requested vote from peers 8eeb4f121c1049a1982d2436f318ac83 (127.1.126.194:33487), 24bef2ea17a4481bbe076f9611baa547 (127.1.126.195:38599)
I20260807 02:20:56.491643 28991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0259491de6f4efaba5f481580357c1d" candidate_uuid: "b69a525dbee448a491ac949efc98f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb4f121c1049a1982d2436f318ac83"
I20260807 02:20:56.491683 29176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0259491de6f4efaba5f481580357c1d" candidate_uuid: "b69a525dbee448a491ac949efc98f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24bef2ea17a4481bbe076f9611baa547"
I20260807 02:20:56.491797 28991 raft_consensus.cc:3037] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:56.491797 29176 raft_consensus.cc:3037] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:56.493093 28991 raft_consensus.cc:2454] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b69a525dbee448a491ac949efc98f97e in term 1.
I20260807 02:20:56.493093 29176 raft_consensus.cc:2454] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b69a525dbee448a491ac949efc98f97e in term 1.
I20260807 02:20:56.493373 28729 leader_election.cc:302] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24bef2ea17a4481bbe076f9611baa547, b69a525dbee448a491ac949efc98f97e; no voters:
I20260807 02:20:56.493541 29272 raft_consensus.cc:2781] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:56.493768 29272 raft_consensus.cc:686] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 1 LEADER]: Becoming Leader. State: Replica: b69a525dbee448a491ac949efc98f97e, State: Running, Role: LEADER
I20260807 02:20:56.494089 29272 consensus_queue.cc:237] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } }
I20260807 02:20:56.497169 28621 catalog_manager.cc:5495] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e reported cstate change: term changed from 0 to 1, leader changed from <none> to b69a525dbee448a491ac949efc98f97e (127.1.126.193). New cstate: current_term: 1 leader_uuid: "b69a525dbee448a491ac949efc98f97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b69a525dbee448a491ac949efc98f97e" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260807 02:20:56.513110 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.509813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.1.126.193:35883)
0807 02:20:56.509931 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.509934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.509947 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:20:56.510033 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.510035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.510084 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.510161 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:56.510384 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.510942 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.511767 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.511967 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.512054 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.512331 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:56.512735 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:56.512826 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.512957 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.513006 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:20:56.518882 29176 raft_consensus.cc:1261] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 1 FOLLOWER]: Refusing update from remote peer b69a525dbee448a491ac949efc98f97e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:56.518882 28991 raft_consensus.cc:1261] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 1 FOLLOWER]: Refusing update from remote peer b69a525dbee448a491ac949efc98f97e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:56.519582 29272 consensus_queue.cc:1035] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24bef2ea17a4481bbe076f9611baa547" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:56.519764 29276 consensus_queue.cc:1035] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eeb4f121c1049a1982d2436f318ac83" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 33487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:56.527323 29279 mvcc.cc:205] Tried to move back new op lower bound from 7315739674693988352 to 7315739674602995712. Current Snapshot: MvccSnapshot[applied={T|T < 7315739674693988352}]
I20260807 02:20:56.528805 29281 mvcc.cc:205] Tried to move back new op lower bound from 7315739674693988352 to 7315739674602995712. Current Snapshot: MvccSnapshot[applied={T|T < 7315739674693988352}]
I20260807 02:20:56.538151 28621 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:56.538338 28621 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:56.540923 28621 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47805ad210074720a655058816b19d7b: Sending DeleteTablet for 3 replicas of tablet b0259491de6f4efaba5f481580357c1d
I20260807 02:20:56.541842 28788 tablet_service.cc:1514] Processing DeleteTablet for tablet b0259491de6f4efaba5f481580357c1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:56 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:52526
I20260807 02:20:56.541842 28962 tablet_service.cc:1514] Processing DeleteTablet for tablet b0259491de6f4efaba5f481580357c1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:56 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:42674
I20260807 02:20:56.541925 29148 tablet_service.cc:1514] Processing DeleteTablet for tablet b0259491de6f4efaba5f481580357c1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:56 UTC) from {username='kudu', principal='kudu/127.1.126.254@KRBTEST.COM'} at 127.0.0.1:42728
I20260807 02:20:56.542392 29299 tablet_replica.cc:330] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e: stopping tablet replica
I20260807 02:20:56.542778 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 28707
I20260807 02:20:56.542774 29299 raft_consensus.cc:2229] T b0259491de6f4efaba5f481580357c1d P b69a525dbee448a491ac949efc98f97e [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:20:56.549196 29301 tablet_replica.cc:330] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: stopping tablet replica
I20260807 02:20:56.549458 29298 tablet_replica.cc:330] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: stopping tablet replica
I20260807 02:20:56.549602 29301 raft_consensus.cc:2229] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:56.549746 29298 raft_consensus.cc:2229] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:56.549997 29298 raft_consensus.cc:2258] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:56.550000 29301 raft_consensus.cc:2258] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:56.551822 29298 ts_tablet_manager.cc:1905] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:56.551978 29301 ts_tablet_manager.cc:1905] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:56.554222 29298 ts_tablet_manager.cc:1918] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:56.554355 29298 log.cc:1196] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/b0259491de6f4efaba5f481580357c1d
I20260807 02:20:56.554749 29298 ts_tablet_manager.cc:1939] T b0259491de6f4efaba5f481580357c1d P 8eeb4f121c1049a1982d2436f318ac83: Deleting consensus metadata
I20260807 02:20:56.555732 29301 ts_tablet_manager.cc:1918] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:56.555845 29301 log.cc:1196] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/b0259491de6f4efaba5f481580357c1d
I20260807 02:20:56.556037 28601 catalog_manager.cc:4841] TS 8eeb4f121c1049a1982d2436f318ac83 (127.1.126.194:33487): tablet b0259491de6f4efaba5f481580357c1d (table test-table [id=14074d201b2b4b5898f49b9ebbb30590]) successfully deleted
I20260807 02:20:56.556253 29301 ts_tablet_manager.cc:1939] T b0259491de6f4efaba5f481580357c1d P 24bef2ea17a4481bbe076f9611baa547: Deleting consensus metadata
I20260807 02:20:56.557520 28601 catalog_manager.cc:4841] TS 24bef2ea17a4481bbe076f9611baa547 (127.1.126.195:38599): tablet b0259491de6f4efaba5f481580357c1d (table test-table [id=14074d201b2b4b5898f49b9ebbb30590]) successfully deleted
W20260807 02:20:56.560465 28601 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:35883 (error 108)
I20260807 02:20:56.561443 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 28877
I20260807 02:20:56.561657 29257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.561318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35883 (local address 127.0.0.1:52556)
0807 02:20:56.561460 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:56.561530 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 02:20:56.565021 28601 catalog_manager.cc:4584] TS b69a525dbee448a491ac949efc98f97e (127.1.126.193:35883): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b0259491de6f4efaba5f481580357c1d: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35883: connect: Connection refused (error 111)
I20260807 02:20:56.571884 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 29065
I20260807 02:20:56.583885 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 28572
2026-08-07T02:20:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2523 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T02:20:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:56Z Disabled control of system clock
I20260807 02:20:56.619593 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:41161
--webserver_interface=127.1.126.254
--webserver_port=0
--builtin_ntp_servers=127.1.126.212:37157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:41161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 02:20:56.734246 29308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:56.734519 29308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:56.734555 29308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:56.738607 29308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:56.738680 29308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:56.738696 29308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:56.738749 29308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:56.738763 29308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:56.743535 29308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:41161
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:41161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:56.744580 29308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:56.745929 29308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:56.754580 29318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:56.754580 29323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:56.754603 29317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:56.754859 29308 server_base.cc:1034] running on GCE node
I20260807 02:20:56.755558 29308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:56.756610 29308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:56.757799 29308 hybrid_clock.cc:648] HybridClock initialized: now 1786069256757750 us; error 39 us; skew 500 ppm
I20260807 02:20:56.759795 29308 webserver.cc:460] Webserver started at http://127.1.126.254:34241/ using document root <none> and password file <none>
I20260807 02:20:56.760407 29308 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:56.760470 29308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:56.760705 29308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:56.762840 29308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "64172501f0114cef9e65e4101709f8cc"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "e15062f549e4b1259745fbc06f7194fd"
server_key_iv: "b84a543a189bf05426cdaf19a118539f"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.763427 29308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "64172501f0114cef9e65e4101709f8cc"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "e15062f549e4b1259745fbc06f7194fd"
server_key_iv: "b84a543a189bf05426cdaf19a118539f"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.767186 29308 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 02:20:56.769663 29329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:56.770978 29308 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:56.771119 29308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "64172501f0114cef9e65e4101709f8cc"
format_stamp: "Formatted at 2026-08-07 02:20:56 on dist-test-slave-39l8"
server_key: "e15062f549e4b1259745fbc06f7194fd"
server_key_iv: "b84a543a189bf05426cdaf19a118539f"
server_key_version: "encryptionkey@0"
I20260807 02:20:56.771240 29308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:56.788268 29308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:56.788995 29308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:56.789211 29308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:56.796389 29308 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:41161
I20260807 02:20:56.796419 29404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:41161 every 8 connection(s)
I20260807 02:20:56.797369 29308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:56.800704 29405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:56.805594 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 29308
I20260807 02:20:56.805778 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:56.806064 1531 external_mini_cluster.cc:1428] Setting key cb7a48df63ce9b0fbd6fd1ea455bbed7
I20260807 02:20:56.806567 29405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc: Bootstrap starting.
I20260807 02:20:56.809128 29405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:56.809926 29405 log.cc:824] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:56.811889 29405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc: No bootstrap required, opened a new log
I20260807 02:20:56.815588 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:56.807557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.1.126.254:41161)
0807 02:20:56.808237 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:56.808264 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:56.808300 (+ 36us) server_negotiation.cc:407] Connection header received
0807 02:20:56.808941 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:56.808957 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:56.809448 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:56.809795 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:56.810226 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.811341 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.812321 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:56.812796 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:56.812976 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:56.813873 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:56.813878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:56.813891 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:56.814278 (+ 387us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:56.814334 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:56.814354 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:56.814468 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:56.814594 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 02:20:56.814881 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":152,"threads_started":1}
I20260807 02:20:56.815467 29405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64172501f0114cef9e65e4101709f8cc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41161 } }
I20260807 02:20:56.815721 29405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:56.815783 29405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64172501f0114cef9e65e4101709f8cc, State: Initialized, Role: FOLLOWER
I20260807 02:20:56.816248 29405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64172501f0114cef9e65e4101709f8cc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41161 } }
I20260807 02:20:56.816408 29405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:56.816473 29405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:56.816576 29405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:56.817448 29405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64172501f0114cef9e65e4101709f8cc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41161 } }
I20260807 02:20:56.817837 29405 leader_election.cc:302] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64172501f0114cef9e65e4101709f8cc; no voters:
I20260807 02:20:56.818197 29405 leader_election.cc:288] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:56.818322 29414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:56.818562 29414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [term 1 LEADER]: Becoming Leader. State: Replica: 64172501f0114cef9e65e4101709f8cc, State: Running, Role: LEADER
I20260807 02:20:56.818950 29414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64172501f0114cef9e65e4101709f8cc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41161 } }
I20260807 02:20:56.819440 29405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:56.820544 29417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64172501f0114cef9e65e4101709f8cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64172501f0114cef9e65e4101709f8cc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41161 } } }
I20260807 02:20:56.820673 29417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:56.821043 29419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64172501f0114cef9e65e4101709f8cc. Latest consensus state: current_term: 1 leader_uuid: "64172501f0114cef9e65e4101709f8cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64172501f0114cef9e65e4101709f8cc" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 41161 } } }
I20260807 02:20:56.821143 29429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:56.821224 29419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:56.824575 29429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:56.830070 29429 catalog_manager.cc:1347] Generated new cluster ID: 407afe2ec3844b6280414c08bafd4e97
I20260807 02:20:56.830133 29429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:56.838230 29429 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:56.839425 29429 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:56.848024 29429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc: Generated new TSK 0
I20260807 02:20:56.848801 29429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:20:56.859998 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.193:0
--local_ip_for_outbound_sockets=127.1.126.193
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41161
--builtin_ntp_servers=127.1.126.212:37157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 02:20:56.977013 29449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:56.977273 29449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:56.977342 29449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:56.981441 29449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:56.981503 29449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:56.981596 29449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.193
I20260807 02:20:56.986380 29449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.126.193
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.193
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:56.987566 29449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:56.989027 29449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:56.998816 29461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:56.998872 29459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:56.998929 29449 server_base.cc:1034] running on GCE node
W20260807 02:20:56.998873 29458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:56.999521 29449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:57.000157 29449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:57.001354 29449 hybrid_clock.cc:648] HybridClock initialized: now 1786069257001340 us; error 26 us; skew 500 ppm
I20260807 02:20:57.007879 29449 webserver.cc:460] Webserver started at http://127.1.126.193:41689/ using document root <none> and password file <none>
I20260807 02:20:57.008502 29449 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:57.008599 29449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:57.008868 29449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:57.011080 29449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data/instance:
uuid: "0d21c029573b4304a9ae0b12205096f5"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "09574e86feb170e56e64f4dc74a8fdbe"
server_key_iv: "81670d01097e9ca6ebd82b2bb7e46719"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.011695 29449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance:
uuid: "0d21c029573b4304a9ae0b12205096f5"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "09574e86feb170e56e64f4dc74a8fdbe"
server_key_iv: "81670d01097e9ca6ebd82b2bb7e46719"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.015520 29449 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:20:57.017987 29467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.019282 29449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:57.019410 29449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal
uuid: "0d21c029573b4304a9ae0b12205096f5"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "09574e86feb170e56e64f4dc74a8fdbe"
server_key_iv: "81670d01097e9ca6ebd82b2bb7e46719"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.019526 29449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:57.036123 29449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:57.036885 29449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:57.037092 29449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:57.037806 29449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:57.038905 29449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:57.038959 29449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.039028 29449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:57.039058 29449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.048305 29449 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.193:35693
I20260807 02:20:57.048329 29629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.193:35693 every 8 connection(s)
I20260807 02:20:57.049237 29449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/data/info.pb
I20260807 02:20:57.058080 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 29449
I20260807 02:20:57.058220 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-0/wal/instance
I20260807 02:20:57.058303 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.051164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.193:44365 (local address 127.1.126.254:41161)
0807 02:20:57.051312 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.051316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.052351 (+ 1035us) server_negotiation.cc:407] Connection header received
0807 02:20:57.053742 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.053745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.053792 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.053867 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:57.054787 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.055326 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.056439 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.056662 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.056739 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.057756 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:57.057759 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:57.057761 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:57.057775 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:57.057794 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:57.057802 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:57.057861 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.058060 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.058110 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:20:57.058555 1531 external_mini_cluster.cc:1428] Setting key 237d64acd49b5acf444edef65e82d794
I20260807 02:20:57.059321 29633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.051518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41161 (local address 127.1.126.193:44365)
0807 02:20:57.052189 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.052229 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.053546 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.054046 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.054053 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.054132 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:57.054612 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.054623 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.055437 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.055439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.056327 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.056337 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.056795 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.056798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.056935 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.057510 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:57.057512 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:57.057550 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:57.057611 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:57.057894 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:57.057907 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:57.057913 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.058055 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.058369 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":119,"threads_started":1}
I20260807 02:20:57.060601 29630 heartbeater.cc:347] Connected to a master server at 127.1.126.254:41161
I20260807 02:20:57.060853 29630 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:57.060839 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.194:0
--local_ip_for_outbound_sockets=127.1.126.194
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41161
--builtin_ntp_servers=127.1.126.212:37157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 02:20:57.061474 29630 heartbeater.cc:511] Master 127.1.126.254:41161 requested a full tablet report, sending...
I20260807 02:20:57.063186 29347 ts_manager.cc:194] Registered new tserver with Master: 0d21c029573b4304a9ae0b12205096f5 (127.1.126.193:35693)
I20260807 02:20:57.064379 29347 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.193:44365
W20260807 02:20:57.179044 29636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:57.179309 29636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:57.179348 29636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:57.183429 29636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:57.183485 29636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:57.183538 29636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.194
I20260807 02:20:57.188249 29636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.126.194
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.194
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:57.189261 29636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:57.190653 29636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:57.200497 29642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:57.200522 29643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:57.200608 29636 server_base.cc:1034] running on GCE node
W20260807 02:20:57.200789 29645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:57.201192 29636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:57.201826 29636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:57.203015 29636 hybrid_clock.cc:648] HybridClock initialized: now 1786069257202995 us; error 32 us; skew 500 ppm
I20260807 02:20:57.204815 29636 webserver.cc:460] Webserver started at http://127.1.126.194:45579/ using document root <none> and password file <none>
I20260807 02:20:57.205422 29636 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:57.205518 29636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:57.205758 29636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:57.207899 29636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data/instance:
uuid: "d5566c3824364d77865f164ef3419910"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "90b3b9e83b8ecfaab5c50181eb52b196"
server_key_iv: "6c5009d6ca446e4cd3d157145dea22b5"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.208534 29636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance:
uuid: "d5566c3824364d77865f164ef3419910"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "90b3b9e83b8ecfaab5c50181eb52b196"
server_key_iv: "6c5009d6ca446e4cd3d157145dea22b5"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.212283 29636 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:20:57.214650 29654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.215873 29636 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:20:57.216012 29636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal
uuid: "d5566c3824364d77865f164ef3419910"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "90b3b9e83b8ecfaab5c50181eb52b196"
server_key_iv: "6c5009d6ca446e4cd3d157145dea22b5"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.216136 29636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:57.252460 29636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:57.253217 29636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:57.253428 29636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:57.254081 29636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:57.255223 29636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:57.255298 29636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.255373 29636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:57.255427 29636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.264411 29636 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.194:46087
I20260807 02:20:57.264437 29829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.194:46087 every 8 connection(s)
I20260807 02:20:57.265331 29636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/data/info.pb
I20260807 02:20:57.269135 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 29636
I20260807 02:20:57.269273 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal/instance
I20260807 02:20:57.269659 1531 external_mini_cluster.cc:1428] Setting key ba9993c211a4e5809fef2babc1789bbc
I20260807 02:20:57.272130 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.126.195:0
--local_ip_for_outbound_sockets=127.1.126.195
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41161
--builtin_ntp_servers=127.1.126.212:37157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 02:20:57.275458 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.267285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:59085 (local address 127.1.126.254:41161)
0807 02:20:57.267452 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.267458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.268530 (+ 1072us) server_negotiation.cc:407] Connection header received
0807 02:20:57.270325 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.270331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.270394 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.270464 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:57.271632 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.272162 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.273359 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.273582 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.273698 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.274939 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:57.274948 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:57.274950 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:57.274963 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:57.274987 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:57.274995 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:57.275072 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.275243 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.275314 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 02:20:57.276329 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.267718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41161 (local address 127.1.126.194:59085)
0807 02:20:57.268381 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.268421 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.270088 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.270674 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.270681 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.270866 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:57.271456 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.271474 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.272298 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.272305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.273213 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.273224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.273738 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.273742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.273905 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.274605 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:57.274607 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:57.274670 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:57.274788 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:57.275088 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:57.275098 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:57.275104 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.275241 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.275521 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":116,"threads_started":1}
I20260807 02:20:57.277436 29830 heartbeater.cc:347] Connected to a master server at 127.1.126.254:41161
I20260807 02:20:57.277719 29830 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:57.278394 29830 heartbeater.cc:511] Master 127.1.126.254:41161 requested a full tablet report, sending...
I20260807 02:20:57.279624 29347 ts_manager.cc:194] Registered new tserver with Master: d5566c3824364d77865f164ef3419910 (127.1.126.194:46087)
I20260807 02:20:57.280201 29347 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.194:59085
W20260807 02:20:57.390765 29833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:57.391034 29833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:57.391108 29833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:57.395959 29833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:57.396020 29833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:57.396145 29833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.126.195
I20260807 02:20:57.401872 29833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.126.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.126.195
--webserver_port=0
--tserver_master_addrs=127.1.126.254:41161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.126.195
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:57.403067 29833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:57.404585 29833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:20:57.415047 29845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:57.415063 29842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:57.415132 29833 server_base.cc:1034] running on GCE node
W20260807 02:20:57.415304 29840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:57.415701 29833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:57.416360 29833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:57.417526 29833 hybrid_clock.cc:648] HybridClock initialized: now 1786069257417509 us; error 28 us; skew 500 ppm
I20260807 02:20:57.419584 29833 webserver.cc:460] Webserver started at http://127.1.126.195:40583/ using document root <none> and password file <none>
I20260807 02:20:57.420331 29833 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:57.420449 29833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:57.420687 29833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:57.423017 29833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data/instance:
uuid: "434c03f3b21e4b82a47abda33b3d4089"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "fa003f946e5e33381ed7d65bfa0ee5ae"
server_key_iv: "7547f71544015c217416648431532b1b"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.423609 29833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance:
uuid: "434c03f3b21e4b82a47abda33b3d4089"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "fa003f946e5e33381ed7d65bfa0ee5ae"
server_key_iv: "7547f71544015c217416648431532b1b"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.427296 29833 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 02:20:57.429720 29851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.431053 29833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:57.431177 29833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal
uuid: "434c03f3b21e4b82a47abda33b3d4089"
format_stamp: "Formatted at 2026-08-07 02:20:57 on dist-test-slave-39l8"
server_key: "fa003f946e5e33381ed7d65bfa0ee5ae"
server_key_iv: "7547f71544015c217416648431532b1b"
server_key_version: "encryptionkey@0"
I20260807 02:20:57.431289 29833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:57.457898 29833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:57.458607 29833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:57.458841 29833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:57.459456 29833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 02:20:57.460502 29833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 02:20:57.460551 29833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.460631 29833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 02:20:57.460675 29833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:57.469578 29833 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.195:46309
I20260807 02:20:57.469606 30017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.195:46309 every 8 connection(s)
I20260807 02:20:57.470544 29833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/data/info.pb
I20260807 02:20:57.479460 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.472408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.195:48617 (local address 127.1.126.254:41161)
0807 02:20:57.472546 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.472558 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.473566 (+ 1008us) server_negotiation.cc:407] Connection header received
0807 02:20:57.475066 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.475069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.475117 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.475203 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:57.476089 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.476608 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.477684 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.477891 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.477981 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.479033 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:57.479037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:57.479039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:57.479052 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:57.479074 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:57.479082 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:57.479141 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.479292 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.479344 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 02:20:57.480250 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.472771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:41161 (local address 127.1.126.195:48617)
0807 02:20:57.473403 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.473442 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.474844 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.475371 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.475378 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.475458 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:20:57.475958 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.475970 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.476716 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.476719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.477570 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.477579 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.478027 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.478029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.478163 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.478769 (+ 606us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 02:20:57.478771 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:20:57.478810 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 02:20:57.478873 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:20:57.479161 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:20:57.479167 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:20:57.479172 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.479268 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.479475 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":116,"threads_started":1}
I20260807 02:20:57.480669 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 29833
I20260807 02:20:57.480800 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal/instance
I20260807 02:20:57.481127 1531 external_mini_cluster.cc:1428] Setting key d02a15be4474191234fdfc71d024cf84
I20260807 02:20:57.481528 30018 heartbeater.cc:347] Connected to a master server at 127.1.126.254:41161
I20260807 02:20:57.481765 30018 heartbeater.cc:464] Registering TS with master...
I20260807 02:20:57.482362 30018 heartbeater.cc:511] Master 127.1.126.254:41161 requested a full tablet report, sending...
I20260807 02:20:57.483415 29347 ts_manager.cc:194] Registered new tserver with Master: 434c03f3b21e4b82a47abda33b3d4089 (127.1.126.195:46309)
I20260807 02:20:57.483974 29347 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.126.195:48617
I20260807 02:20:57.494894 1531 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 02:20:57.500331 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.496881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54570 (local address 127.1.126.254:41161)
0807 02:20:57.497002 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.497006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.497178 (+ 172us) server_negotiation.cc:407] Connection header received
0807 02:20:57.497270 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.497273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.497313 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.497384 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:57.497634 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.498128 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.498984 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.499198 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.499277 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.499994 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:57.499997 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:57.499999 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:20:57.500011 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:57.500028 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:20:57.500036 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:57.500094 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.500179 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.500223 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 02:20:57.503199 29347 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 02:20:57.506245 29347 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 02:20:57.521117 30038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.515458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49996 (local address 127.1.126.194:46087)
0807 02:20:57.516057 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.516069 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.516091 (+ 22us) server_negotiation.cc:407] Connection header received
0807 02:20:57.516167 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.516172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.516352 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.516510 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:57.516969 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.518125 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.519585 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.520345 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.520496 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.520781 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.520841 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.520941 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":118,"threads_started":1}
I20260807 02:20:57.521148 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.515195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:46309 (local address 127.0.0.1:47930)
0807 02:20:57.516251 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.516264 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.516342 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.517061 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.517064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.517083 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:57.517162 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.517167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.518435 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.518441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.519557 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.519569 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.520645 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.520649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.520744 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.520769 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.520820 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.520964 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":996,"mutex_wait_us":3,"thread_start_us":123,"threads_started":1}
I20260807 02:20:57.521173 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.514889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.194:46087 (local address 127.0.0.1:49996)
0807 02:20:57.515459 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.515476 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.515591 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.516729 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.516732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.516750 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:57.516835 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.516840 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.518251 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.518255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.519474 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.519482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.520494 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.520498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.520644 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.520696 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.520801 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.521034 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":124,"spinlock_wait_cycles":3456,"thread_start_us":102,"threads_started":1}
I20260807 02:20:57.521390 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.514834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38794 (local address 127.1.126.193:35693)
0807 02:20:57.515764 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.515774 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.515795 (+ 21us) server_negotiation.cc:407] Connection header received
0807 02:20:57.515860 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.515863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.516092 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.516251 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:57.516784 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.517770 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.519466 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.520363 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.520487 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.520718 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.521114 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.521224 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":811,"thread_start_us":138,"threads_started":1}
I20260807 02:20:57.521589 30036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.514648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35693 (local address 127.0.0.1:38794)
0807 02:20:57.515409 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.515457 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.515589 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.516432 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.516440 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.516465 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:57.516643 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.516651 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.517884 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.517890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.519322 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.519334 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.520775 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.520779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.520875 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.520896 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.520962 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.521026 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":49,"thread_start_us":106,"threads_started":1}
I20260807 02:20:57.522244 30039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.515847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47930 (local address 127.1.126.195:46309)
0807 02:20:57.516619 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.516636 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.516659 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:20:57.516731 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.516736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.516912 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.517060 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:57.517290 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.518328 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.519685 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.520472 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.521758 (+ 1286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.521933 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.521979 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.522085 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":133,"threads_started":1}
I20260807 02:20:57.524567 29725 tablet_service.cc:1467] Processing CreateTablet for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 (DEFAULT_TABLE table=test-table [id=7c12ee77e09f4f829c8619937694df2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:57.524606 29533 tablet_service.cc:1467] Processing CreateTablet for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 (DEFAULT_TABLE table=test-table [id=7c12ee77e09f4f829c8619937694df2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:57.524606 29922 tablet_service.cc:1467] Processing CreateTablet for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 (DEFAULT_TABLE table=test-table [id=7c12ee77e09f4f829c8619937694df2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 02:20:57.525561 29725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:57.525632 29533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:57.525628 29922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:57.531941 30041 tablet_bootstrap.cc:492] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Bootstrap starting.
I20260807 02:20:57.533452 30042 tablet_bootstrap.cc:492] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: Bootstrap starting.
I20260807 02:20:57.534178 30041 tablet_bootstrap.cc:654] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:57.535037 30041 log.cc:824] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:57.535092 30043 tablet_bootstrap.cc:492] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Bootstrap starting.
I20260807 02:20:57.535501 30042 tablet_bootstrap.cc:654] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:57.536351 30042 log.cc:824] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:57.537221 30041 tablet_bootstrap.cc:492] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: No bootstrap required, opened a new log
I20260807 02:20:57.537336 30043 tablet_bootstrap.cc:654] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:57.537420 30041 ts_tablet_manager.cc:1397] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 02:20:57.537997 30043 log.cc:824] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:57.538383 30042 tablet_bootstrap.cc:492] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: No bootstrap required, opened a new log
I20260807 02:20:57.538568 30042 ts_tablet_manager.cc:1397] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 02:20:57.539638 30043 tablet_bootstrap.cc:492] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: No bootstrap required, opened a new log
I20260807 02:20:57.539829 30043 ts_tablet_manager.cc:1397] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 02:20:57.541893 30041 raft_consensus.cc:348] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.542168 30041 raft_consensus.cc:374] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:57.542225 30041 raft_consensus.cc:729] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5566c3824364d77865f164ef3419910, State: Initialized, Role: FOLLOWER
I20260807 02:20:57.542747 30041 consensus_queue.cc:260] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.543181 30043 raft_consensus.cc:348] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.543416 30043 raft_consensus.cc:374] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:57.543464 30043 raft_consensus.cc:729] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434c03f3b21e4b82a47abda33b3d4089, State: Initialized, Role: FOLLOWER
I20260807 02:20:57.543479 29830 heartbeater.cc:503] Master 127.1.126.254:41161 was elected leader, sending a full tablet report...
I20260807 02:20:57.543820 30041 ts_tablet_manager.cc:1428] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 02:20:57.542848 30042 raft_consensus.cc:348] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.543946 30042 raft_consensus.cc:374] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:57.543905 30043 consensus_queue.cc:260] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.543996 30042 raft_consensus.cc:729] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d21c029573b4304a9ae0b12205096f5, State: Initialized, Role: FOLLOWER
I20260807 02:20:57.544385 30042 consensus_queue.cc:260] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.544829 30043 ts_tablet_manager.cc:1428] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 02:20:57.544982 30018 heartbeater.cc:503] Master 127.1.126.254:41161 was elected leader, sending a full tablet report...
I20260807 02:20:57.545295 30042 ts_tablet_manager.cc:1428] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260807 02:20:57.545631 29630 heartbeater.cc:503] Master 127.1.126.254:41161 was elected leader, sending a full tablet report...
W20260807 02:20:57.550405 29632 tablet.cc:2369] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 02:20:57.593928 30051 raft_consensus.cc:482] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 02:20:57.594259 30051 raft_consensus.cc:504] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.595537 30051 leader_election.cc:288] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d21c029573b4304a9ae0b12205096f5 (127.1.126.193:35693), 434c03f3b21e4b82a47abda33b3d4089 (127.1.126.195:46309)
I20260807 02:20:57.600441 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.595928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:50829 (local address 127.1.126.193:35693)
0807 02:20:57.596043 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.596047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.596356 (+ 309us) server_negotiation.cc:407] Connection header received
0807 02:20:57.596567 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.596570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.596618 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.596719 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:57.596980 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.597689 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.599057 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.599662 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.599792 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.599843 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.600244 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.600311 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:20:57.600441 30039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.596010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.126.194:35209 (local address 127.1.126.195:46309)
0807 02:20:57.596138 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.596143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.596166 (+ 23us) server_negotiation.cc:407] Connection header received
0807 02:20:57.596217 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.596219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.596258 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.596347 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 02:20:57.596720 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.597503 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.599057 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.599662 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.599792 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.599843 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.600244 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.600311 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:20:57.600468 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.595776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.195:46309 (local address 127.1.126.194:35209)
0807 02:20:57.595936 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.595952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.596048 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.596418 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.596424 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.596443 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:57.596585 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.596591 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.597618 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.597622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.598921 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.598932 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.599796 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.599800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.600062 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.600125 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.600206 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.600302 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":109}
I20260807 02:20:57.600476 30055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.595776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35693 (local address 127.1.126.194:50829)
0807 02:20:57.596241 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.596252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 02:20:57.596387 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:20:57.596742 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:20:57.596744 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:20:57.596761 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 02:20:57.596843 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.596847 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.597782 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.597785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.598921 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:20:57.598932 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.599796 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.599800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:20:57.600060 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.600125 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 02:20:57.600206 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 02:20:57.600302 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":231,"thread_start_us":114,"threads_started":1}
I20260807 02:20:57.601233 29946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a5f3f87b46c428eb15bb044ad5d7ed5" candidate_uuid: "d5566c3824364d77865f164ef3419910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434c03f3b21e4b82a47abda33b3d4089" is_pre_election: true
I20260807 02:20:57.601261 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a5f3f87b46c428eb15bb044ad5d7ed5" candidate_uuid: "d5566c3824364d77865f164ef3419910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d21c029573b4304a9ae0b12205096f5" is_pre_election: true
I20260807 02:20:57.601531 29561 raft_consensus.cc:2454] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5566c3824364d77865f164ef3419910 in term 0.
I20260807 02:20:57.601533 29946 raft_consensus.cc:2454] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5566c3824364d77865f164ef3419910 in term 0.
I20260807 02:20:57.602073 29660 leader_election.cc:302] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434c03f3b21e4b82a47abda33b3d4089, d5566c3824364d77865f164ef3419910; no voters:
I20260807 02:20:57.602346 30051 raft_consensus.cc:2781] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 02:20:57.602447 30051 raft_consensus.cc:482] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 02:20:57.602527 30051 raft_consensus.cc:3037] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:57.603634 30051 raft_consensus.cc:504] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.604004 30051 leader_election.cc:288] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [CANDIDATE]: Term 1 election: Requested vote from peers 0d21c029573b4304a9ae0b12205096f5 (127.1.126.193:35693), 434c03f3b21e4b82a47abda33b3d4089 (127.1.126.195:46309)
I20260807 02:20:57.604351 29946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a5f3f87b46c428eb15bb044ad5d7ed5" candidate_uuid: "d5566c3824364d77865f164ef3419910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434c03f3b21e4b82a47abda33b3d4089"
I20260807 02:20:57.604362 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a5f3f87b46c428eb15bb044ad5d7ed5" candidate_uuid: "d5566c3824364d77865f164ef3419910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d21c029573b4304a9ae0b12205096f5"
I20260807 02:20:57.604455 29946 raft_consensus.cc:3037] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:57.604498 29561 raft_consensus.cc:3037] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:57.605528 29946 raft_consensus.cc:2454] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5566c3824364d77865f164ef3419910 in term 1.
I20260807 02:20:57.605548 29561 raft_consensus.cc:2454] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5566c3824364d77865f164ef3419910 in term 1.
I20260807 02:20:57.605855 29660 leader_election.cc:302] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434c03f3b21e4b82a47abda33b3d4089, d5566c3824364d77865f164ef3419910; no voters:
I20260807 02:20:57.606025 30051 raft_consensus.cc:2781] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:57.606236 30051 raft_consensus.cc:686] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 1 LEADER]: Becoming Leader. State: Replica: d5566c3824364d77865f164ef3419910, State: Running, Role: LEADER
I20260807 02:20:57.606606 30051 consensus_queue.cc:237] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } }
I20260807 02:20:57.610157 29348 catalog_manager.cc:5495] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5566c3824364d77865f164ef3419910 (127.1.126.194). New cstate: current_term: 1 leader_uuid: "d5566c3824364d77865f164ef3419910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5566c3824364d77865f164ef3419910" member_type: VOTER last_known_addr { host: "127.1.126.194" port: 46087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 } health_report { overall_health: UNKNOWN } } }
I20260807 02:20:57.641680 30038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.638451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50000 (local address 127.1.126.194:46087)
0807 02:20:57.638597 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:57.638601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:57.638613 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:20:57.638716 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:57.638718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:57.638775 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:57.638862 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:20:57.639076 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.639560 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.640353 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:57.640551 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:57.640625 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:57.640881 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:20:57.641327 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:20:57.641415 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:57.641499 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 02:20:57.641543 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 02:20:57.647442 29946 raft_consensus.cc:1261] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 1 FOLLOWER]: Refusing update from remote peer d5566c3824364d77865f164ef3419910: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:57.647444 29561 raft_consensus.cc:1261] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 1 FOLLOWER]: Refusing update from remote peer d5566c3824364d77865f164ef3419910: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:20:57.648219 30057 consensus_queue.cc:1035] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d21c029573b4304a9ae0b12205096f5" member_type: VOTER last_known_addr { host: "127.1.126.193" port: 35693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:57.648409 30051 consensus_queue.cc:1035] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434c03f3b21e4b82a47abda33b3d4089" member_type: VOTER last_known_addr { host: "127.1.126.195" port: 46309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:20:57.654693 30060 mvcc.cc:205] Tried to move back new op lower bound from 7315739679316803584 to 7315739679159578624. Current Snapshot: MvccSnapshot[applied={T|T < 7315739679316803584}]
I20260807 02:20:57.657518 30062 mvcc.cc:205] Tried to move back new op lower bound from 7315739679316803584 to 7315739679159578624. Current Snapshot: MvccSnapshot[applied={T|T < 7315739679316803584 or (T in {7315739679316803584})}]
I20260807 02:20:57.664709 29348 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:57.664886 29348 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 02:20:57.667347 29348 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64172501f0114cef9e65e4101709f8cc: Sending DeleteTablet for 3 replicas of tablet 7a5f3f87b46c428eb15bb044ad5d7ed5
I20260807 02:20:57.668154 29725 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:57 UTC) from {username='slave'} at 127.0.0.1:49996
I20260807 02:20:57.668154 29533 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:57 UTC) from {username='slave'} at 127.0.0.1:38794
I20260807 02:20:57.668679 30073 tablet_replica.cc:330] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: stopping tablet replica
I20260807 02:20:57.668673 29922 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 02:20:57 UTC) from {username='slave'} at 127.0.0.1:47930
I20260807 02:20:57.668984 30074 tablet_replica.cc:330] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5: stopping tablet replica
I20260807 02:20:57.669351 30074 raft_consensus.cc:2229] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 0d21c029573b4304a9ae0b12205096f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:57.669513 30075 tablet_replica.cc:330] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: stopping tablet replica
I20260807 02:20:57.669613 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 29449
I20260807 02:20:57.669770 30073 raft_consensus.cc:2229] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 1 LEADER]: Raft consensus shutting down.
I20260807 02:20:57.669824 30075 raft_consensus.cc:2229] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 02:20:57.670176 30075 raft_consensus.cc:2258] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:57.670217 30073 raft_consensus.cc:2258] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 02:20:57.673559 30075 ts_tablet_manager.cc:1905] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:57.676179 30073 ts_tablet_manager.cc:1905] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 02:20:57.678738 30075 ts_tablet_manager.cc:1918] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:57.678889 30075 log.cc:1196] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-2/wal/wals/7a5f3f87b46c428eb15bb044ad5d7ed5
I20260807 02:20:57.679046 30073 ts_tablet_manager.cc:1918] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 02:20:57.679225 30073 log.cc:1196] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Deleting WAL directory at /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786069003535869-1531-0/minicluster-data/ts-1/wal/wals/7a5f3f87b46c428eb15bb044ad5d7ed5
I20260807 02:20:57.679386 30075 ts_tablet_manager.cc:1939] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P 434c03f3b21e4b82a47abda33b3d4089: Deleting consensus metadata
I20260807 02:20:57.679633 30073 ts_tablet_manager.cc:1939] T 7a5f3f87b46c428eb15bb044ad5d7ed5 P d5566c3824364d77865f164ef3419910: Deleting consensus metadata
I20260807 02:20:57.686414 29330 catalog_manager.cc:4841] TS d5566c3824364d77865f164ef3419910 (127.1.126.194:46087): tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 (table test-table [id=7c12ee77e09f4f829c8619937694df2a]) successfully deleted
I20260807 02:20:57.686777 29332 catalog_manager.cc:4841] TS 434c03f3b21e4b82a47abda33b3d4089 (127.1.126.195:46309): tablet 7a5f3f87b46c428eb15bb044ad5d7ed5 (table test-table [id=7c12ee77e09f4f829c8619937694df2a]) successfully deleted
W20260807 02:20:57.694684 29333 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.126.193:35693 (error 108)
I20260807 02:20:57.694778 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 29636
I20260807 02:20:57.700263 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:57.699065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.193:35693 (local address 127.0.0.1:38796)
0807 02:20:57.700108 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0807 02:20:57.700180 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":944}
W20260807 02:20:57.701056 29333 catalog_manager.cc:4584] TS 0d21c029573b4304a9ae0b12205096f5 (127.1.126.193:35693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7a5f3f87b46c428eb15bb044ad5d7ed5: Network error: Client connection negotiation failed: client connection to 127.1.126.193:35693: connect: Connection refused (error 111)
I20260807 02:20:57.711269 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 29833
I20260807 02:20:57.725067 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 29308
2026-08-07T02:20:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1142 ms)
[----------] 6 tests from EncryptionPolicyTest (10892 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:20:57 dist-test-slave-39l8 krb5kdc[30081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:20:57 dist-test-slave-39l8 krb5kdc[30081](info): set up 2 sockets
Aug 07 02:20:57 dist-test-slave-39l8 krb5kdc[30081](info): commencing operation
krb5kdc: starting...
W20260807 02:20:58.946965 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:20:59 dist-test-slave-39l8 krb5kdc[30081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:20:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:20:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:20:59.075837 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36379
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:20:59.192071 30097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:20:59.192368 30097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:20:59.192452 30097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:20:59.196547 30097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:20:59.196635 30097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:20:59.196674 30097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:20:59.196730 30097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:20:59.196766 30097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:20:59.202495 30097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36379
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:20:59.203625 30097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:20:59.204675 30097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:20:59.213500 30097 server_base.cc:1034] running on GCE node
W20260807 02:20:59.213510 30103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:59.213542 30102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:20:59.213587 30106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:20:59.214382 30097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:20:59.215499 30097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:20:59.216655 30097 hybrid_clock.cc:648] HybridClock initialized: now 1786069259216626 us; error 43 us; skew 500 ppm
Aug 07 02:20:59 dist-test-slave-39l8 krb5kdc[30081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069259, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:20:59.219398 30097 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:20:59.220329 30097 webserver.cc:460] Webserver started at http://127.0.0.1:45817/ using document root <none> and password file <none>
I20260807 02:20:59.220886 30097 fs_manager.cc:359] Metadata directory not provided
I20260807 02:20:59.220947 30097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:20:59.221164 30097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:20:59.223307 30097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "2cc2a1c3afea4507bb493d0f35229a4f"
format_stamp: "Formatted at 2026-08-07 02:20:59 on dist-test-slave-39l8"
server_key: "13a4af1e80efbc1885e9ca8ca41e52e1"
server_key_iv: "38f4bd372a3d05f481a8a33ebe9ac4ac"
server_key_version: "encryptionkey@0"
I20260807 02:20:59.223860 30097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "2cc2a1c3afea4507bb493d0f35229a4f"
format_stamp: "Formatted at 2026-08-07 02:20:59 on dist-test-slave-39l8"
server_key: "13a4af1e80efbc1885e9ca8ca41e52e1"
server_key_iv: "38f4bd372a3d05f481a8a33ebe9ac4ac"
server_key_version: "encryptionkey@0"
I20260807 02:20:59.227560 30097 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:20:59.229921 30118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:20:59.231171 30097 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:20:59.231325 30097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "2cc2a1c3afea4507bb493d0f35229a4f"
format_stamp: "Formatted at 2026-08-07 02:20:59 on dist-test-slave-39l8"
server_key: "13a4af1e80efbc1885e9ca8ca41e52e1"
server_key_iv: "38f4bd372a3d05f481a8a33ebe9ac4ac"
server_key_version: "encryptionkey@0"
I20260807 02:20:59.231441 30097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:20:59.264473 30097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:20:59.267707 30097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:20:59.267947 30097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:20:59.275538 30097 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36379
I20260807 02:20:59.275555 30192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36379 every 8 connection(s)
I20260807 02:20:59.276518 30097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:20:59.279407 30193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:20:59.283586 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 30097
I20260807 02:20:59.283752 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:20:59.284055 1531 external_mini_cluster.cc:1428] Setting key 398e8534aac59632afc3e0a68e3478cb
I20260807 02:20:59.285396 30193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f: Bootstrap starting.
I20260807 02:20:59.287848 30193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f: Neither blocks nor log segments found. Creating new log.
I20260807 02:20:59.288733 30193 log.cc:824] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f: Log is configured to *not* fsync() on all Append() calls
I20260807 02:20:59.291008 30193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f: No bootstrap required, opened a new log
Aug 07 02:20:59 dist-test-slave-39l8 krb5kdc[30081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 02:20:59.295908 30193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36379 } }
I20260807 02:20:59.296180 30193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:20:59.296250 30193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc2a1c3afea4507bb493d0f35229a4f, State: Initialized, Role: FOLLOWER
I20260807 02:20:59.296763 30193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36379 } }
I20260807 02:20:59.296895 30193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:20:59.296984 30193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:20:59.297088 30193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:20:59.297941 30193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36379 } }
I20260807 02:20:59.298312 30193 leader_election.cc:302] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cc2a1c3afea4507bb493d0f35229a4f; no voters:
I20260807 02:20:59.298717 30193 leader_election.cc:288] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:20:59.298831 30200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:20:59.299005 30200 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [term 1 LEADER]: Becoming Leader. State: Replica: 2cc2a1c3afea4507bb493d0f35229a4f, State: Running, Role: LEADER
I20260807 02:20:59.299309 30200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36379 } }
I20260807 02:20:59.299857 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:59.285629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36621 (local address 127.0.0.1:36379)
0807 02:20:59.286084 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:59.286101 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:59.286143 (+ 42us) server_negotiation.cc:407] Connection header received
0807 02:20:59.286845 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:59.286864 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:59.287226 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:59.287502 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:59.288481 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:59.289775 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:59.290956 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:59.291491 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:59.291618 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:59.294461 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:59.294468 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:59.294484 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:59.294518 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:59.296514 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:59.297098 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:59.297106 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:59.297114 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:59.297278 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:59.297620 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:59.297623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:59.297625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:59.298011 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:59.298229 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:59.298595 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 02:20:59.298907 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":137,"threads_started":1}
I20260807 02:20:59.300007 30193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:20:59.300509 30200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cc2a1c3afea4507bb493d0f35229a4f. Latest consensus state: current_term: 1 leader_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36379 } } }
I20260807 02:20:59.300622 30200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:59.300891 30201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2a1c3afea4507bb493d0f35229a4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36379 } } }
I20260807 02:20:59.300995 30201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f [sys.catalog]: This master's current role is: LEADER
I20260807 02:20:59.303303 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 02:20:59.305179 30226 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:20:59.305261 30226 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:20:59.305341 30207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:20:59.306350 30207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:20:59.312608 30207 catalog_manager.cc:1347] Generated new cluster ID: f18c0fca474e43b59a7108c1b80bfd30
I20260807 02:20:59.312695 30207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:20:59.315218 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:20:59.305278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59795 (local address 127.0.0.1:36379)
0807 02:20:59.305381 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 02:20:59.305387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:20:59.305868 (+ 481us) server_negotiation.cc:407] Connection header received
0807 02:20:59.305989 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:20:59.305991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:20:59.306034 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:20:59.306098 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:20:59.307026 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:59.307805 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:59.308755 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:20:59.309008 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:20:59.309126 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:20:59.310763 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:20:59.310767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:20:59.310770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:20:59.310797 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:20:59.313257 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:59.313799 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:59.313803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:59.313805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:59.313894 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:20:59.314261 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:20:59.314265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:20:59.314267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:20:59.314489 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:20:59.314640 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 02:20:59.314949 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 02:20:59.315057 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 02:20:59.346418 30207 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:20:59.347486 30207 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:20:59.352367 30207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cc2a1c3afea4507bb493d0f35229a4f: Generated new TSK 0
I20260807 02:20:59.353091 30207 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:20:59.367735 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 30097
W20260807 02:20:59.378603 30078 connection.cc:535] client connection to 127.0.0.1:36379 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36379): Connection reset by peer (error 104)
2026-08-07T02:20:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1640 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:20:59 dist-test-slave-39l8 krb5kdc[30238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:20:59 dist-test-slave-39l8 krb5kdc[30238](info): set up 2 sockets
Aug 07 02:20:59 dist-test-slave-39l8 krb5kdc[30238](info): commencing operation
krb5kdc: starting...
W20260807 02:21:00.588274 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:00 dist-test-slave-39l8 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:00.714764 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46099
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:00.826330 30255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:00.826613 30255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:00.826699 30255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:00.830632 30255 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:00.830744 30255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:00.830808 30255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:00.830865 30255 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:00.830901 30255 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:00.836019 30255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46099
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:00.837030 30255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:00.838151 30255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:00.846626 30267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:00.846633 30263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:00.846766 30255 server_base.cc:1034] running on GCE node
W20260807 02:21:00.846655 30261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:00.847434 30255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:00.848443 30255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:00.849629 30255 hybrid_clock.cc:648] HybridClock initialized: now 1786069260849612 us; error 30 us; skew 500 ppm
Aug 07 02:21:00 dist-test-slave-39l8 krb5kdc[30238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069260, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:00.852408 30255 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:00.853278 30255 webserver.cc:460] Webserver started at http://127.0.0.1:41019/ using document root <none> and password file <none>
I20260807 02:21:00.853820 30255 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:00.853910 30255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:00.854141 30255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:00.856144 30255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "f7b5097ebd34479bb04f8f66459372b9"
format_stamp: "Formatted at 2026-08-07 02:21:00 on dist-test-slave-39l8"
server_key: "35f16b84d5832608dd139cfb9864b4fd"
server_key_iv: "208a32f91c643ee48494cbcd0564f2c2"
server_key_version: "encryptionkey@0"
I20260807 02:21:00.856710 30255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "f7b5097ebd34479bb04f8f66459372b9"
format_stamp: "Formatted at 2026-08-07 02:21:00 on dist-test-slave-39l8"
server_key: "35f16b84d5832608dd139cfb9864b4fd"
server_key_iv: "208a32f91c643ee48494cbcd0564f2c2"
server_key_version: "encryptionkey@0"
I20260807 02:21:00.860400 30255 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 02:21:00.863283 30277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:00.864413 30255 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:00.864537 30255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "f7b5097ebd34479bb04f8f66459372b9"
format_stamp: "Formatted at 2026-08-07 02:21:00 on dist-test-slave-39l8"
server_key: "35f16b84d5832608dd139cfb9864b4fd"
server_key_iv: "208a32f91c643ee48494cbcd0564f2c2"
server_key_version: "encryptionkey@0"
I20260807 02:21:00.864641 30255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:00.882205 30255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:00.885300 30255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:00.885519 30255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:00.892989 30255 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46099
I20260807 02:21:00.893047 30356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46099 every 8 connection(s)
I20260807 02:21:00.893966 30255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:00.896960 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:00.901257 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 30255
I20260807 02:21:00.901427 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:00.901777 1531 external_mini_cluster.cc:1428] Setting key 1fdb41aeffa90c22f739b6d1b24e9ed7
I20260807 02:21:00.903699 30357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9: Bootstrap starting.
I20260807 02:21:00.906062 30357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:00.906944 30357 log.cc:824] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:00.909030 30357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9: No bootstrap required, opened a new log
I20260807 02:21:00.910843 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:00.903285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58627 (local address 127.0.0.1:46099)
0807 02:21:00.903746 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:00.903760 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:00.903822 (+ 62us) server_negotiation.cc:407] Connection header received
0807 02:21:00.904471 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:00.904488 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:00.904808 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:00.905134 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:00.905555 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:00.906608 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:00.907573 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:00.908034 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:00.908218 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:00.909154 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:00.909161 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:00.909185 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:00.909563 (+ 378us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:00.909616 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:00.909638 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:00.909782 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:00.909965 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 02:21:00.910100 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":148,"threads_started":1}
I20260807 02:21:00.913597 30357 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b5097ebd34479bb04f8f66459372b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46099 } }
I20260807 02:21:00.913899 30357 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:00.913975 30357 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b5097ebd34479bb04f8f66459372b9, State: Initialized, Role: FOLLOWER
I20260807 02:21:00.913985 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:00.914418 30357 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b5097ebd34479bb04f8f66459372b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46099 } }
I20260807 02:21:00.914561 30357 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:00.914662 30357 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:00.914809 30357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:00.915865 30357 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b5097ebd34479bb04f8f66459372b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46099 } }
I20260807 02:21:00.916294 30357 leader_election.cc:302] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7b5097ebd34479bb04f8f66459372b9; no voters:
I20260807 02:21:00.916785 30357 leader_election.cc:288] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:00.916883 30368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:00.917135 30368 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [term 1 LEADER]: Becoming Leader. State: Replica: f7b5097ebd34479bb04f8f66459372b9, State: Running, Role: LEADER
I20260807 02:21:00.917488 30368 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b5097ebd34479bb04f8f66459372b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46099 } }
I20260807 02:21:00.918226 30357 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:00.918576 30368 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7b5097ebd34479bb04f8f66459372b9. Latest consensus state: current_term: 1 leader_uuid: "f7b5097ebd34479bb04f8f66459372b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b5097ebd34479bb04f8f66459372b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46099 } } }
I20260807 02:21:00.918731 30368 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:00.919103 30369 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7b5097ebd34479bb04f8f66459372b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b5097ebd34479bb04f8f66459372b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46099 } } }
I20260807 02:21:00.919270 30369 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:00.919206 30373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:00.922297 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:00.916311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48775 (local address 127.0.0.1:46099)
0807 02:21:00.916461 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:00.916468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:00.916620 (+ 152us) server_negotiation.cc:407] Connection header received
0807 02:21:00.916708 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:00.916715 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:00.916774 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:00.916869 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:00.917371 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:00.918205 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:00.919643 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:00.920096 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:00.920200 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:00.921680 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:00.921687 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:00.921692 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:00.921709 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:00.921741 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:00.921754 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:00.921836 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:00.922126 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 02:21:00.922162 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 02:21:00.922986 30373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:00.930672 30373 catalog_manager.cc:1347] Generated new cluster ID: 20bf09d063914530a01d64e0540b9d4f
I20260807 02:21:00.930810 30373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:00.938591 30373 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:00.939481 30373 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:00.954631 30373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7b5097ebd34479bb04f8f66459372b9: Generated new TSK 0
I20260807 02:21:00.955338 30373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:00.960788 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 30255
W20260807 02:21:00.976016 30235 connection.cc:535] client connection to 127.0.0.1:46099 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46099): Connection reset by peer (error 104)
2026-08-07T02:21:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:01 dist-test-slave-39l8 krb5kdc[30403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:01 dist-test-slave-39l8 krb5kdc[30403](info): set up 2 sockets
Aug 07 02:21:01 dist-test-slave-39l8 krb5kdc[30403](info): commencing operation
krb5kdc: starting...
W20260807 02:21:02.172888 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:02 dist-test-slave-39l8 krb5kdc[30403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:02.296861 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46449
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:02.408560 30426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:02.408867 30426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:02.408954 30426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:02.413004 30426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:02.413107 30426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:02.413146 30426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:02.413185 30426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:02.413218 30426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:02.418457 30426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46449
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:02.419528 30426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:02.420542 30426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:21:02.428926 30426 server_base.cc:1034] running on GCE node
W20260807 02:21:02.428894 30437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:02.428889 30439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:02.428884 30443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:02.429674 30426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:02.430799 30426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:02.431980 30426 hybrid_clock.cc:648] HybridClock initialized: now 1786069262431967 us; error 34 us; skew 500 ppm
Aug 07 02:21:02 dist-test-slave-39l8 krb5kdc[30403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069262, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:02.438086 30426 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:02.439031 30426 webserver.cc:460] Webserver started at http://127.0.0.1:37137/ using document root <none> and password file <none>
I20260807 02:21:02.439631 30426 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:02.439726 30426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:02.439965 30426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:02.442092 30426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9"
format_stamp: "Formatted at 2026-08-07 02:21:02 on dist-test-slave-39l8"
server_key: "3d06fa741130c28c449898e9e4daface"
server_key_iv: "6db9af34dc1db31e80b2a0fd8bae2933"
server_key_version: "encryptionkey@0"
I20260807 02:21:02.442768 30426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9"
format_stamp: "Formatted at 2026-08-07 02:21:02 on dist-test-slave-39l8"
server_key: "3d06fa741130c28c449898e9e4daface"
server_key_iv: "6db9af34dc1db31e80b2a0fd8bae2933"
server_key_version: "encryptionkey@0"
I20260807 02:21:02.446341 30426 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:21:02.449093 30454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:02.450253 30426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:02.450492 30426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9"
format_stamp: "Formatted at 2026-08-07 02:21:02 on dist-test-slave-39l8"
server_key: "3d06fa741130c28c449898e9e4daface"
server_key_iv: "6db9af34dc1db31e80b2a0fd8bae2933"
server_key_version: "encryptionkey@0"
I20260807 02:21:02.450610 30426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:02.455227 30426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:02.457981 30426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:02.458182 30426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:02.465378 30426 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46449
I20260807 02:21:02.465412 30525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46449 every 8 connection(s)
I20260807 02:21:02.466259 30426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:02.468935 30526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:02.472872 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 30426
I20260807 02:21:02.473085 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:02.473387 1531 external_mini_cluster.cc:1428] Setting key 172cd05e3b1ae8a66eb2b2c3cef0d0e4
I20260807 02:21:02.474833 30526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9: Bootstrap starting.
I20260807 02:21:02.477591 30526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:02.478483 30526 log.cc:824] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:02.479030 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:02.474834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32797 (local address 127.0.0.1:46449)
0807 02:21:02.475296 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:02.475315 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:02.475356 (+ 41us) server_negotiation.cc:407] Connection header received
0807 02:21:02.476212 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:02.476236 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:02.476569 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:02.476917 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:02.477649 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:02.477655 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:02.477670 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:02.477683 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:02.477749 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:02.477781 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:02.477907 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:02.477999 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 02:21:02.478150 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":154,"threads_started":1}
I20260807 02:21:02.480388 30526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9: No bootstrap required, opened a new log
I20260807 02:21:02.481650 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:02.484347 30526 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260807 02:21:02.484620 30526 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:02.484684 30526 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf0c1961dc9e4bd687911cc23fcd5eb9, State: Initialized, Role: FOLLOWER
I20260807 02:21:02.485145 30526 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260807 02:21:02.485355 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:02.483713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53357 (local address 127.0.0.1:46449)
0807 02:21:02.483824 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:02.483828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:02.483963 (+ 135us) server_negotiation.cc:407] Connection header received
0807 02:21:02.484085 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:02.484087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:02.484116 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:02.484176 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:02.484983 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:02.484986 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:02.484988 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:02.485000 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:02.485027 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:02.485039 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:02.485128 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:02.485201 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 02:21:02.485236 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:21:02.485339 30526 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:02.485446 30526 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:02.485560 30526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:02.486419 30526 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260807 02:21:02.486815 30526 leader_election.cc:302] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf0c1961dc9e4bd687911cc23fcd5eb9; no voters:
I20260807 02:21:02.487147 30526 leader_election.cc:288] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:02.487262 30543 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:02.487493 30543 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [term 1 LEADER]: Becoming Leader. State: Replica: bf0c1961dc9e4bd687911cc23fcd5eb9, State: Running, Role: LEADER
I20260807 02:21:02.487869 30543 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260807 02:21:02.488354 30526 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:02.488976 30543 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf0c1961dc9e4bd687911cc23fcd5eb9. Latest consensus state: current_term: 1 leader_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } } }
I20260807 02:21:02.489168 30543 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:02.489420 30545 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c1961dc9e4bd687911cc23fcd5eb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } } }
I20260807 02:21:02.489557 30545 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:02.489677 30554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:02.492789 30554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:02.498211 30554 catalog_manager.cc:1347] Generated new cluster ID: 153f5083ac4844d4a80e04e47f14619c
I20260807 02:21:02.498278 30554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:02.508810 30554 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:02.509111 30554 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:02.516005 30554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf0c1961dc9e4bd687911cc23fcd5eb9: Generated new TSK 0
I20260807 02:21:02.516757 30554 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:02.521481 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 30426
2026-08-07T02:21:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:02 dist-test-slave-39l8 krb5kdc[30573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:02 dist-test-slave-39l8 krb5kdc[30573](info): set up 2 sockets
Aug 07 02:21:02 dist-test-slave-39l8 krb5kdc[30573](info): commencing operation
krb5kdc: starting...
W20260807 02:21:03.732885 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:03 dist-test-slave-39l8 krb5kdc[30573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:03.861075 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36227
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:03.977681 30589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:03.977967 30589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:03.978040 30589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:03.982100 30589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:03.982194 30589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:03.982235 30589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:03.982293 30589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:03.982333 30589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:03.987499 30589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:03.988508 30589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:03.989511 30589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:03.998147 30597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:03.998344 30589 server_base.cc:1034] running on GCE node
W20260807 02:21:03.998147 30600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:03.998162 30598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:03.999075 30589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:04.000108 30589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:04.001269 30589 hybrid_clock.cc:648] HybridClock initialized: now 1786069264001244 us; error 52 us; skew 500 ppm
Aug 07 02:21:03 dist-test-slave-39l8 krb5kdc[30573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069263, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:04.004149 30589 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:04.004959 30589 webserver.cc:460] Webserver started at http://127.0.0.1:44981/ using document root <none> and password file <none>
I20260807 02:21:04.005501 30589 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:04.005561 30589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:04.005734 30589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:04.007784 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "4f8e6f2320d247419576b93f64b2a8c8"
format_stamp: "Formatted at 2026-08-07 02:21:03 on dist-test-slave-39l8"
server_key: "385456d6d90ff3a076677fca080b14c7"
server_key_iv: "d261822f01f29f72029e60d3fe660869"
server_key_version: "encryptionkey@0"
I20260807 02:21:04.008301 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "4f8e6f2320d247419576b93f64b2a8c8"
format_stamp: "Formatted at 2026-08-07 02:21:03 on dist-test-slave-39l8"
server_key: "385456d6d90ff3a076677fca080b14c7"
server_key_iv: "d261822f01f29f72029e60d3fe660869"
server_key_version: "encryptionkey@0"
I20260807 02:21:04.012069 30589 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:21:04.015564 30614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:04.017102 30589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 02:21:04.017257 30589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "4f8e6f2320d247419576b93f64b2a8c8"
format_stamp: "Formatted at 2026-08-07 02:21:03 on dist-test-slave-39l8"
server_key: "385456d6d90ff3a076677fca080b14c7"
server_key_iv: "d261822f01f29f72029e60d3fe660869"
server_key_version: "encryptionkey@0"
I20260807 02:21:04.017386 30589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:04.043584 30589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:04.046656 30589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:04.046885 30589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:04.054440 30589 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36227
I20260807 02:21:04.054473 30689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36227 every 8 connection(s)
I20260807 02:21:04.055413 30589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:04.058009 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 30589
I20260807 02:21:04.058171 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:04.058286 30690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:04.058501 1531 external_mini_cluster.cc:1428] Setting key 127e7cfcf325d98a5c4d55e022213eed
I20260807 02:21:04.065762 30690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8: Bootstrap starting.
I20260807 02:21:04.068638 30690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8: Neither blocks nor log segments found. Creating new log.
Aug 07 02:21:04 dist-test-slave-39l8 krb5kdc[30573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 02:21:04.069443 30690 log.cc:824] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:04.071382 30690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8: No bootstrap required, opened a new log
I20260807 02:21:04.074476 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:04.060509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49571 (local address 127.0.0.1:36227)
0807 02:21:04.061011 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:04.061051 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:04.061099 (+ 48us) server_negotiation.cc:407] Connection header received
0807 02:21:04.062081 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:04.062101 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:04.062437 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:04.062777 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:04.063679 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:04.064933 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:04.066112 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:04.066591 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:04.066772 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:04.069681 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:04.069687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:04.069699 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:04.069727 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:04.071531 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:04.072024 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:04.072029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:04.072034 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:04.072145 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:04.072541 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:04.072545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:04.072549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:04.072931 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:04.073143 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:04.073440 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 02:21:04.073744 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":147,"threads_started":1}
I20260807 02:21:04.075069 30690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f8e6f2320d247419576b93f64b2a8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260807 02:21:04.075309 30690 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:04.075402 30690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f8e6f2320d247419576b93f64b2a8c8, State: Initialized, Role: FOLLOWER
I20260807 02:21:04.075903 30690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f8e6f2320d247419576b93f64b2a8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260807 02:21:04.076072 30690 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:04.076153 30690 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:04.076285 30690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:04.077350 30690 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f8e6f2320d247419576b93f64b2a8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260807 02:21:04.077553 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:04.077737 30690 leader_election.cc:302] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f8e6f2320d247419576b93f64b2a8c8; no voters:
I20260807 02:21:04.078087 30690 leader_election.cc:288] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:04.078207 30697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:04.078454 30697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 4f8e6f2320d247419576b93f64b2a8c8, State: Running, Role: LEADER
I20260807 02:21:04.078881 30697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f8e6f2320d247419576b93f64b2a8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260807 02:21:04.079440 30690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:04.080202 30697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f8e6f2320d247419576b93f64b2a8c8. Latest consensus state: current_term: 1 leader_uuid: "4f8e6f2320d247419576b93f64b2a8c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f8e6f2320d247419576b93f64b2a8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } } }
I20260807 02:21:04.080410 30697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:04.080667 30700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f8e6f2320d247419576b93f64b2a8c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f8e6f2320d247419576b93f64b2a8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } } }
I20260807 02:21:04.080860 30700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:04.080909 30716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:04.085641 30716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:04.089640 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:04.079856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42039 (local address 127.0.0.1:36227)
0807 02:21:04.079960 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:04.079964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:04.080218 (+ 254us) server_negotiation.cc:407] Connection header received
0807 02:21:04.080534 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:04.080538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:04.080601 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:04.080664 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:04.081624 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:04.082388 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:04.083526 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:04.083845 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:04.083923 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:04.085728 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:04.085732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:04.085735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:04.085761 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:04.087608 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:04.088167 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:04.088171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:04.088173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:04.088263 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:04.088610 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:04.088614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:04.088615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:04.088842 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:04.088977 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:04.089275 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 02:21:04.089423 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 02:21:04.093184 30716 catalog_manager.cc:1347] Generated new cluster ID: 48aee1515f5f4bff9f624f342e0f947c
I20260807 02:21:04.093267 30716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:04.113942 30716 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:04.115329 30716 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:04.123471 30716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f8e6f2320d247419576b93f64b2a8c8: Generated new TSK 0
I20260807 02:21:04.124334 30716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:04.137723 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 30589
2026-08-07T02:21:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1615 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:04 dist-test-slave-39l8 krb5kdc[30731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:04 dist-test-slave-39l8 krb5kdc[30731](info): set up 2 sockets
Aug 07 02:21:04 dist-test-slave-39l8 krb5kdc[30731](info): commencing operation
krb5kdc: starting...
W20260807 02:21:05.357098 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:05 dist-test-slave-39l8 krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:05.485109 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41171
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:05.600497 30749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:05.600835 30749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:05.600914 30749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:05.605042 30749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:05.605100 30749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:05.605127 30749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:05.605144 30749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:05.605199 30749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:05.610443 30749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:05.611575 30749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:05.612689 30749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:05.621464 30757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:05.621470 30756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:05.621528 30759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:05.621791 30749 server_base.cc:1034] running on GCE node
I20260807 02:21:05.622444 30749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:05.623610 30749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:05.624805 30749 hybrid_clock.cc:648] HybridClock initialized: now 1786069265624797 us; error 29 us; skew 500 ppm
Aug 07 02:21:05 dist-test-slave-39l8 krb5kdc[30731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069265, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:05.627725 30749 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:05.628885 30749 webserver.cc:460] Webserver started at http://127.0.0.1:45169/ using document root <none> and password file <none>
I20260807 02:21:05.629557 30749 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:05.629652 30749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:05.629920 30749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:05.632872 30749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "d0daca68d9484a5c9ae7189e30145a40"
format_stamp: "Formatted at 2026-08-07 02:21:05 on dist-test-slave-39l8"
server_key: "630776985128b30a121adc9048d41947"
server_key_iv: "7feb1d07250612cd3944594cd56d38e1"
server_key_version: "encryptionkey@0"
I20260807 02:21:05.633656 30749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "d0daca68d9484a5c9ae7189e30145a40"
format_stamp: "Formatted at 2026-08-07 02:21:05 on dist-test-slave-39l8"
server_key: "630776985128b30a121adc9048d41947"
server_key_iv: "7feb1d07250612cd3944594cd56d38e1"
server_key_version: "encryptionkey@0"
I20260807 02:21:05.639281 30749 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 02:21:05.642560 30768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:05.643973 30749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:21:05.644109 30749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "d0daca68d9484a5c9ae7189e30145a40"
format_stamp: "Formatted at 2026-08-07 02:21:05 on dist-test-slave-39l8"
server_key: "630776985128b30a121adc9048d41947"
server_key_iv: "7feb1d07250612cd3944594cd56d38e1"
server_key_version: "encryptionkey@0"
I20260807 02:21:05.644254 30749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:05.667237 30749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:05.672189 30749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:05.672428 30749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:05.683009 30749 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41171
I20260807 02:21:05.683038 30842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41171 every 8 connection(s)
I20260807 02:21:05.684392 30749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:05.687791 30843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:05.692137 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 30749
I20260807 02:21:05.692291 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:05.692581 1531 external_mini_cluster.cc:1428] Setting key 492d5cb27b0299203830f6ba62fe336d
I20260807 02:21:05.694001 30843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40: Bootstrap starting.
I20260807 02:21:05.696602 30843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:05.697415 30843 log.cc:824] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:05.699625 30843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40: No bootstrap required, opened a new log
I20260807 02:21:05.702148 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:05.693988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41681 (local address 127.0.0.1:41171)
0807 02:21:05.694453 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:05.694468 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:05.694503 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:21:05.695191 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:05.695211 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:05.695554 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:05.695835 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:05.696242 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:05.697572 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:05.698799 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:05.699262 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:05.699380 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:05.700231 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:05.700237 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:05.700249 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:05.700622 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:05.700677 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:05.700699 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:05.700774 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:05.700949 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 02:21:05.701168 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":125,"threads_started":1}
I20260807 02:21:05.703078 30843 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0daca68d9484a5c9ae7189e30145a40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260807 02:21:05.703293 30843 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:05.703372 30843 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0daca68d9484a5c9ae7189e30145a40, State: Initialized, Role: FOLLOWER
I20260807 02:21:05.703804 30843 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0daca68d9484a5c9ae7189e30145a40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260807 02:21:05.703923 30843 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:05.704010 30843 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:05.704115 30843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:05.705149 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:05.705157 30843 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0daca68d9484a5c9ae7189e30145a40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260807 02:21:05.705492 30843 leader_election.cc:302] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0daca68d9484a5c9ae7189e30145a40; no voters:
I20260807 02:21:05.705814 30843 leader_election.cc:288] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:05.705878 30851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:05.706104 30851 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [term 1 LEADER]: Becoming Leader. State: Replica: d0daca68d9484a5c9ae7189e30145a40, State: Running, Role: LEADER
I20260807 02:21:05.706399 30851 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0daca68d9484a5c9ae7189e30145a40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } }
I20260807 02:21:05.707144 30843 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:05.708155 30854 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0daca68d9484a5c9ae7189e30145a40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0daca68d9484a5c9ae7189e30145a40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } } }
I20260807 02:21:05.708170 30853 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0daca68d9484a5c9ae7189e30145a40. Latest consensus state: current_term: 1 leader_uuid: "d0daca68d9484a5c9ae7189e30145a40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0daca68d9484a5c9ae7189e30145a40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41171 } } }
I20260807 02:21:05.708357 30854 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:05.708360 30853 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:05.708788 30873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:05.712109 30873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:05.714805 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:05.707358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56951 (local address 127.0.0.1:41171)
0807 02:21:05.707465 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:05.707471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:05.708111 (+ 640us) server_negotiation.cc:407] Connection header received
0807 02:21:05.708714 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:05.708717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:05.708762 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:05.708849 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:05.709241 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:05.709972 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:05.711105 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:05.711446 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:05.711524 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:05.714341 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:05.714345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:05.714348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:05.714360 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:05.714394 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:05.714405 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:05.714488 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:05.714588 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 02:21:05.714644 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:21:05.717592 30873 catalog_manager.cc:1347] Generated new cluster ID: 5521d139d1334fc5a9da62827ae200ad
I20260807 02:21:05.717664 30873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:05.733174 30873 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:05.734433 30873 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:05.742496 30873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0daca68d9484a5c9ae7189e30145a40: Generated new TSK 0
I20260807 02:21:05.743235 30873 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:05.755581 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 30749
2026-08-07T02:21:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1612 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:05 dist-test-slave-39l8 krb5kdc[30888](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:05 dist-test-slave-39l8 krb5kdc[30888](info): set up 2 sockets
Aug 07 02:21:05 dist-test-slave-39l8 krb5kdc[30888](info): commencing operation
krb5kdc: starting...
W20260807 02:21:06.969933 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:07 dist-test-slave-39l8 krb5kdc[30888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:07.099380 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:07.218751 30909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:07.219024 30909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:07.219069 30909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:07.223047 30909 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:07.223109 30909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:07.223129 30909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:07.223150 30909 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:07.223165 30909 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:07.228441 30909 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:07.229471 30909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:07.230484 30909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:07.239377 30918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:07.239372 30915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:07.239372 30916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:07.239689 30909 server_base.cc:1034] running on GCE node
I20260807 02:21:07.240250 30909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:07.241395 30909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:07.242599 30909 hybrid_clock.cc:648] HybridClock initialized: now 1786069267242579 us; error 31 us; skew 500 ppm
Aug 07 02:21:07 dist-test-slave-39l8 krb5kdc[30888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:07.245354 30909 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:07.246562 30909 webserver.cc:460] Webserver started at http://127.0.0.1:33701/ using document root <none> and password file <none>
I20260807 02:21:07.247256 30909 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:07.247324 30909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:07.247498 30909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:07.249583 30909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8"
format_stamp: "Formatted at 2026-08-07 02:21:07 on dist-test-slave-39l8"
server_key: "655f533544147c0e60202ac2732a5d35"
server_key_iv: "9656a2a4518978f825d5f46354b228fb"
server_key_version: "encryptionkey@0"
I20260807 02:21:07.250185 30909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8"
format_stamp: "Formatted at 2026-08-07 02:21:07 on dist-test-slave-39l8"
server_key: "655f533544147c0e60202ac2732a5d35"
server_key_iv: "9656a2a4518978f825d5f46354b228fb"
server_key_version: "encryptionkey@0"
I20260807 02:21:07.254086 30909 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:21:07.256639 30930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:07.257926 30909 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:07.258044 30909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8"
format_stamp: "Formatted at 2026-08-07 02:21:07 on dist-test-slave-39l8"
server_key: "655f533544147c0e60202ac2732a5d35"
server_key_iv: "9656a2a4518978f825d5f46354b228fb"
server_key_version: "encryptionkey@0"
I20260807 02:21:07.258144 30909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:07.262923 30909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:07.265776 30909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:07.265940 30909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:07.273253 30909 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45671
I20260807 02:21:07.273313 31009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45671 every 8 connection(s)
I20260807 02:21:07.274278 30909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:07.276621 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 30909
I20260807 02:21:07.276777 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:07.277127 1531 external_mini_cluster.cc:1428] Setting key 4f75791f6e3e56244a0a00e85900771f
I20260807 02:21:07.277549 31010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:07.282851 31014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:07.278653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49471 (local address 127.0.0.1:45671)
0807 02:21:07.279145 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:07.279166 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:07.279203 (+ 37us) server_negotiation.cc:407] Connection header received
0807 02:21:07.279901 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:07.279917 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:07.280211 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:07.280539 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:07.281466 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:07.281475 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:07.281494 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:07.281509 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:07.281575 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:07.281604 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:07.281740 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:07.281879 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 02:21:07.282058 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":142,"threads_started":1}
I20260807 02:21:07.284493 31010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8: Bootstrap starting.
I20260807 02:21:07.285564 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:07.287113 31010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:07.288066 31010 log.cc:824] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:07.289672 31014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:07.287954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58429 (local address 127.0.0.1:45671)
0807 02:21:07.288084 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:07.288089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:07.288299 (+ 210us) server_negotiation.cc:407] Connection header received
0807 02:21:07.288419 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:07.288422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:07.288469 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:07.288556 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:07.289299 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:07.289302 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:07.289305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:07.289317 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:07.289343 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:07.289355 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:07.289444 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:07.289506 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 02:21:07.289543 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 02:21:07.290371 31010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8: No bootstrap required, opened a new log
I20260807 02:21:07.294150 31010 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45671 } }
I20260807 02:21:07.294449 31010 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:07.294513 31010 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7fbb99e2d9c485697a33e2f0e00a9f8, State: Initialized, Role: FOLLOWER
I20260807 02:21:07.295006 31010 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45671 } }
I20260807 02:21:07.295159 31010 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:07.295252 31010 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:07.295370 31010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:07.296268 31010 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45671 } }
I20260807 02:21:07.296617 31010 leader_election.cc:302] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7fbb99e2d9c485697a33e2f0e00a9f8; no voters:
I20260807 02:21:07.296944 31010 leader_election.cc:288] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:07.297092 31023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:07.297349 31023 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [term 1 LEADER]: Becoming Leader. State: Replica: c7fbb99e2d9c485697a33e2f0e00a9f8, State: Running, Role: LEADER
I20260807 02:21:07.297652 31023 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45671 } }
I20260807 02:21:07.298275 31010 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:07.298817 31025 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7fbb99e2d9c485697a33e2f0e00a9f8. Latest consensus state: current_term: 1 leader_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45671 } } }
I20260807 02:21:07.298952 31025 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:07.299212 31024 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7fbb99e2d9c485697a33e2f0e00a9f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45671 } } }
I20260807 02:21:07.299341 31024 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:07.299445 31027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:07.302476 31027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:07.307866 31027 catalog_manager.cc:1347] Generated new cluster ID: efd1c7b6f74f407cae7be1cd570905ac
I20260807 02:21:07.307931 31027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:07.322988 31027 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:07.323369 31027 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:07.328835 31027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7fbb99e2d9c485697a33e2f0e00a9f8: Generated new TSK 0
I20260807 02:21:07.329536 31027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:07.337656 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 30909
2026-08-07T02:21:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1584 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:07 dist-test-slave-39l8 krb5kdc[31056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:07 dist-test-slave-39l8 krb5kdc[31056](info): set up 2 sockets
Aug 07 02:21:07 dist-test-slave-39l8 krb5kdc[31056](info): commencing operation
krb5kdc: starting...
W20260807 02:21:08.561877 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:08 dist-test-slave-39l8 krb5kdc[31056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:08.685961 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:08.795553 31072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:08.795854 31072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:08.795938 31072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:08.799819 31072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:08.799902 31072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:08.799942 31072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:08.800015 31072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:08.800051 31072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:08.805194 31072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:08.806208 31072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:08.807221 31072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:08.815620 31080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:08.815675 31083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:08.815712 31072 server_base.cc:1034] running on GCE node
W20260807 02:21:08.815675 31081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:08.816419 31072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:08.817469 31072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:08.818658 31072 hybrid_clock.cc:648] HybridClock initialized: now 1786069268818645 us; error 36 us; skew 500 ppm
Aug 07 02:21:08 dist-test-slave-39l8 krb5kdc[31056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:08.826392 31072 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:08.827325 31072 webserver.cc:460] Webserver started at http://127.0.0.1:39723/ using document root <none> and password file <none>
I20260807 02:21:08.827919 31072 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:08.828011 31072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:08.828250 31072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:08.830238 31072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "915779d5d5ae49f788e3d96854742d9d"
format_stamp: "Formatted at 2026-08-07 02:21:08 on dist-test-slave-39l8"
server_key: "5a80884751292dd6cfceb1889e49e459"
server_key_iv: "d8d802b07bab1b35f38968dc1f484cd2"
server_key_version: "encryptionkey@0"
I20260807 02:21:08.830845 31072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "915779d5d5ae49f788e3d96854742d9d"
format_stamp: "Formatted at 2026-08-07 02:21:08 on dist-test-slave-39l8"
server_key: "5a80884751292dd6cfceb1889e49e459"
server_key_iv: "d8d802b07bab1b35f38968dc1f484cd2"
server_key_version: "encryptionkey@0"
I20260807 02:21:08.834565 31072 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:21:08.836983 31090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:08.838105 31072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:08.838249 31072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "915779d5d5ae49f788e3d96854742d9d"
format_stamp: "Formatted at 2026-08-07 02:21:08 on dist-test-slave-39l8"
server_key: "5a80884751292dd6cfceb1889e49e459"
server_key_iv: "d8d802b07bab1b35f38968dc1f484cd2"
server_key_version: "encryptionkey@0"
I20260807 02:21:08.838361 31072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:08.855286 31072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:08.858560 31072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:08.858812 31072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:08.866091 31072 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44039
I20260807 02:21:08.866118 31162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44039 every 8 connection(s)
I20260807 02:21:08.867038 31072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:08.869675 31163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:08.872576 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 31072
I20260807 02:21:08.872716 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:08.872992 1531 external_mini_cluster.cc:1428] Setting key 70aaa26d7b0307fce5e49ba2b463ce73
I20260807 02:21:08.875982 31163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d: Bootstrap starting.
I20260807 02:21:08.878679 31163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:08.879513 31163 log.cc:824] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:08.881541 31163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d: No bootstrap required, opened a new log
Aug 07 02:21:08 dist-test-slave-39l8 krb5kdc[31056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 02:21:08.885079 31163 raft_consensus.cc:348] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "915779d5d5ae49f788e3d96854742d9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260807 02:21:08.885303 31163 raft_consensus.cc:374] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:08.885366 31163 raft_consensus.cc:729] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 915779d5d5ae49f788e3d96854742d9d, State: Initialized, Role: FOLLOWER
I20260807 02:21:08.885814 31163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "915779d5d5ae49f788e3d96854742d9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260807 02:21:08.885932 31163 raft_consensus.cc:388] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:08.886018 31163 raft_consensus.cc:482] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:08.886143 31163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:08.887382 31163 raft_consensus.cc:504] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "915779d5d5ae49f788e3d96854742d9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260807 02:21:08.887725 31163 leader_election.cc:302] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 915779d5d5ae49f788e3d96854742d9d; no voters:
I20260807 02:21:08.888125 31163 leader_election.cc:288] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:08.888219 31170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:08.888509 31170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [term 1 LEADER]: Becoming Leader. State: Replica: 915779d5d5ae49f788e3d96854742d9d, State: Running, Role: LEADER
I20260807 02:21:08.888873 31170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "915779d5d5ae49f788e3d96854742d9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260807 02:21:08.889456 31163 sys_catalog.cc:564] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:08.889503 31166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:08.874547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:50509 (local address 127.0.0.1:44039)
0807 02:21:08.875042 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:08.875063 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:08.875105 (+ 42us) server_negotiation.cc:407] Connection header received
0807 02:21:08.875909 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:08.875932 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:08.876364 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:08.876726 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:08.877386 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:08.878870 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:08.879784 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:08.880357 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:08.880509 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:08.883420 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:08.883426 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:08.883438 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:08.883464 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:08.886069 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:08.886690 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:08.886694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:08.886699 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:08.886874 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:08.887237 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:08.887239 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:08.887240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:08.887689 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:08.887859 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:08.888291 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 02:21:08.888561 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":190,"threads_started":1}
I20260807 02:21:08.890589 31172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "915779d5d5ae49f788e3d96854742d9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "915779d5d5ae49f788e3d96854742d9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } } }
I20260807 02:21:08.891004 31172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:08.890899 31174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 915779d5d5ae49f788e3d96854742d9d. Latest consensus state: current_term: 1 leader_uuid: "915779d5d5ae49f788e3d96854742d9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "915779d5d5ae49f788e3d96854742d9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } } }
I20260807 02:21:08.891342 31174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:08.892895 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 02:21:08.895555 31190 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:08.895620 31190 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:08.895706 31184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:08.896729 31184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:08.903199 31184 catalog_manager.cc:1347] Generated new cluster ID: 72abef971b6d4b599df77b732c55af5a
I20260807 02:21:08.903259 31184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:08.904222 31166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:08.895076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:49245 (local address 127.0.0.1:44039)
0807 02:21:08.895182 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:08.895189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:08.895940 (+ 751us) server_negotiation.cc:407] Connection header received
0807 02:21:08.896046 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:08.896049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:08.896098 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:08.896193 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:08.896998 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:08.897836 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:08.898820 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:08.899081 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:08.899205 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:08.900530 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:08.900534 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:08.900536 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:08.900560 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:08.902231 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:08.902843 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:08.902846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:08.902847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:08.902927 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:08.903350 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:08.903353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:08.903354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:08.903517 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:08.903670 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:08.903943 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 02:21:08.904027 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 02:21:08.920928 31184 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:08.922192 31184 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:08.935286 31184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 915779d5d5ae49f788e3d96854742d9d: Generated new TSK 0
I20260807 02:21:08.936175 31184 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:08.950070 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 31072
W20260807 02:21:08.965144 31053 connection.cc:535] client connection to 127.0.0.1:44039 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44039): Connection reset by peer (error 104)
2026-08-07T02:21:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1615 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:09 dist-test-slave-39l8 krb5kdc[31206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:09 dist-test-slave-39l8 krb5kdc[31206](info): set up 2 sockets
Aug 07 02:21:09 dist-test-slave-39l8 krb5kdc[31206](info): commencing operation
krb5kdc: starting...
W20260807 02:21:10.165997 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:10 dist-test-slave-39l8 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:10.294024 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44517
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:10.407763 31226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:10.408036 31226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:10.408079 31226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:10.412206 31226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:10.412268 31226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:10.412288 31226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:10.412305 31226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:10.412320 31226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:10.417496 31226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:10.418509 31226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:10.419569 31226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:10.428155 31239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:10.428197 31241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:10.428335 31226 server_base.cc:1034] running on GCE node
W20260807 02:21:10.428177 31238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:10.429013 31226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:10.430042 31226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:10.431202 31226 hybrid_clock.cc:648] HybridClock initialized: now 1786069270431185 us; error 30 us; skew 500 ppm
Aug 07 02:21:10 dist-test-slave-39l8 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:10.434003 31226 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:10.434940 31226 webserver.cc:460] Webserver started at http://127.0.0.1:45541/ using document root <none> and password file <none>
I20260807 02:21:10.435510 31226 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:10.435618 31226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:10.435858 31226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:10.437873 31226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "874abb1292b44221a7a3074a83feb52e"
format_stamp: "Formatted at 2026-08-07 02:21:10 on dist-test-slave-39l8"
server_key: "ce0b1834a4251ca5b677a1a1aa324f73"
server_key_iv: "63243271a456284ddde109bfa7a2c8f3"
server_key_version: "encryptionkey@0"
I20260807 02:21:10.438433 31226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "874abb1292b44221a7a3074a83feb52e"
format_stamp: "Formatted at 2026-08-07 02:21:10 on dist-test-slave-39l8"
server_key: "ce0b1834a4251ca5b677a1a1aa324f73"
server_key_iv: "63243271a456284ddde109bfa7a2c8f3"
server_key_version: "encryptionkey@0"
I20260807 02:21:10.442121 31226 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:21:10.444613 31248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:10.445770 31226 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:10.445911 31226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "874abb1292b44221a7a3074a83feb52e"
format_stamp: "Formatted at 2026-08-07 02:21:10 on dist-test-slave-39l8"
server_key: "ce0b1834a4251ca5b677a1a1aa324f73"
server_key_iv: "63243271a456284ddde109bfa7a2c8f3"
server_key_version: "encryptionkey@0"
I20260807 02:21:10.446026 31226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:10.457444 31226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:10.460822 31226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:10.461024 31226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:10.468209 31226 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44517
I20260807 02:21:10.468284 31321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44517 every 8 connection(s)
I20260807 02:21:10.469175 31226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:10.470434 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 31226
I20260807 02:21:10.470628 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:10.470988 1531 external_mini_cluster.cc:1428] Setting key e421321e8e0f368f9c5d8b8b80186559
I20260807 02:21:10.472370 31325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:10.479295 31325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e: Bootstrap starting.
I20260807 02:21:10.480901 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:10.472455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:35915 (local address 127.0.0.1:44517)
0807 02:21:10.472891 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:10.472912 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:10.472954 (+ 42us) server_negotiation.cc:407] Connection header received
0807 02:21:10.473793 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:10.473818 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:10.474236 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:10.474588 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:10.475032 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:10.476537 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:10.477458 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:10.478157 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:10.478332 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:10.479243 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:10.479247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:10.479259 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:10.479695 (+ 436us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:10.479746 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:10.479770 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:10.479917 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:10.480082 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 02:21:10.480221 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":111,"threads_started":1}
I20260807 02:21:10.481613 31325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:10.482375 31325 log.cc:824] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:10.483857 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:10.484580 31325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e: No bootstrap required, opened a new log
I20260807 02:21:10.488489 31325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874abb1292b44221a7a3074a83feb52e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44517 } }
I20260807 02:21:10.488736 31325 raft_consensus.cc:374] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:10.488819 31325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874abb1292b44221a7a3074a83feb52e, State: Initialized, Role: FOLLOWER
I20260807 02:21:10.489301 31325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874abb1292b44221a7a3074a83feb52e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44517 } }
I20260807 02:21:10.489463 31325 raft_consensus.cc:388] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:10.489545 31325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:10.489665 31325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:10.489929 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:10.485947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:35375 (local address 127.0.0.1:44517)
0807 02:21:10.486075 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:10.486081 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:10.486258 (+ 177us) server_negotiation.cc:407] Connection header received
0807 02:21:10.486395 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:10.486398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:10.486446 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:10.486531 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:10.486843 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:10.487338 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:10.488171 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:10.488402 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:10.488512 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:10.489396 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:10.489399 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:10.489402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:10.489418 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:10.489447 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:10.489460 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:10.489569 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:10.489745 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 02:21:10.489791 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:21:10.490883 31325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874abb1292b44221a7a3074a83feb52e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44517 } }
I20260807 02:21:10.491233 31325 leader_election.cc:302] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 874abb1292b44221a7a3074a83feb52e; no voters:
I20260807 02:21:10.491484 31325 leader_election.cc:288] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:10.491662 31341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:10.491894 31341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [term 1 LEADER]: Becoming Leader. State: Replica: 874abb1292b44221a7a3074a83feb52e, State: Running, Role: LEADER
I20260807 02:21:10.492280 31341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874abb1292b44221a7a3074a83feb52e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44517 } }
I20260807 02:21:10.492923 31325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:10.494045 31344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 874abb1292b44221a7a3074a83feb52e. Latest consensus state: current_term: 1 leader_uuid: "874abb1292b44221a7a3074a83feb52e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874abb1292b44221a7a3074a83feb52e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44517 } } }
I20260807 02:21:10.494181 31344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:10.494517 31342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "874abb1292b44221a7a3074a83feb52e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "874abb1292b44221a7a3074a83feb52e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44517 } } }
I20260807 02:21:10.494642 31342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:10.494586 31354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:10.497782 31354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:10.503298 31354 catalog_manager.cc:1347] Generated new cluster ID: cc1a8d6176a1486190403e7c4fa2341d
I20260807 02:21:10.503369 31354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:10.523037 31354 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:10.524020 31354 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:10.528488 31354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 874abb1292b44221a7a3074a83feb52e: Generated new TSK 0
I20260807 02:21:10.529145 31354 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:10.533329 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 31226
W20260807 02:21:10.547884 31201 connection.cc:535] client connection to 127.0.0.1:44517 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44517): Connection reset by peer (error 104)
2026-08-07T02:21:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:10 dist-test-slave-39l8 krb5kdc[31376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:10 dist-test-slave-39l8 krb5kdc[31376](info): set up 2 sockets
Aug 07 02:21:10 dist-test-slave-39l8 krb5kdc[31376](info): commencing operation
krb5kdc: starting...
W20260807 02:21:11.748071 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:11 dist-test-slave-39l8 krb5kdc[31376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:11.881531 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:11.996922 31399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:11.997246 31399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:11.997330 31399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:12.001384 31399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:12.001487 31399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:12.001528 31399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:12.001587 31399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:12.001636 31399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:12.007099 31399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:12.008198 31399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:12.009248 31399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:12.020089 31406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:12.020119 31409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:12.020680 31407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:12.021113 31399 server_base.cc:1034] running on GCE node
I20260807 02:21:12.021719 31399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:12.023099 31399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:12.024322 31399 hybrid_clock.cc:648] HybridClock initialized: now 1786069272024296 us; error 50 us; skew 500 ppm
Aug 07 02:21:12 dist-test-slave-39l8 krb5kdc[31376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069272, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:12.027376 31399 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:12.028401 31399 webserver.cc:460] Webserver started at http://127.0.0.1:44599/ using document root <none> and password file <none>
I20260807 02:21:12.029004 31399 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:12.029099 31399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:12.029352 31399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:12.031544 31399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "85d20dc5f9d545f687b2f40cf142ffc8"
format_stamp: "Formatted at 2026-08-07 02:21:12 on dist-test-slave-39l8"
server_key: "1178f6454e48d7f6acba0f7584afbbcc"
server_key_iv: "a54b669d2e104f66d05f7044659d235d"
server_key_version: "encryptionkey@0"
I20260807 02:21:12.032150 31399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "85d20dc5f9d545f687b2f40cf142ffc8"
format_stamp: "Formatted at 2026-08-07 02:21:12 on dist-test-slave-39l8"
server_key: "1178f6454e48d7f6acba0f7584afbbcc"
server_key_iv: "a54b669d2e104f66d05f7044659d235d"
server_key_version: "encryptionkey@0"
I20260807 02:21:12.035970 31399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:21:12.038571 31418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:12.039853 31399 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:21:12.040007 31399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "85d20dc5f9d545f687b2f40cf142ffc8"
format_stamp: "Formatted at 2026-08-07 02:21:12 on dist-test-slave-39l8"
server_key: "1178f6454e48d7f6acba0f7584afbbcc"
server_key_iv: "a54b669d2e104f66d05f7044659d235d"
server_key_version: "encryptionkey@0"
I20260807 02:21:12.040167 31399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:12.044950 31399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:12.048117 31399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:12.048341 31399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:12.055692 31399 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34965
I20260807 02:21:12.055717 31491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34965 every 8 connection(s)
I20260807 02:21:12.056620 31399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:12.058413 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 31399
I20260807 02:21:12.058573 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:12.058931 1531 external_mini_cluster.cc:1428] Setting key 3b52dc6f6462fddc8690255fae8591e6
I20260807 02:21:12.059686 31493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:12.064851 31496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:12.060392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:56061 (local address 127.0.0.1:34965)
0807 02:21:12.060828 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:12.060849 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:12.060892 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:21:12.061776 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:12.061802 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:12.062190 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:12.062557 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:12.063396 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:12.063402 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:12.063417 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:12.063430 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:12.063498 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:12.063532 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:12.063694 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:12.063765 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 02:21:12.063917 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":110,"threads_started":1}
I20260807 02:21:12.066954 31493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8: Bootstrap starting.
I20260807 02:21:12.067770 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:12.069557 31493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:12.070418 31493 log.cc:824] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:12.071715 31496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:12.069824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:58215 (local address 127.0.0.1:34965)
0807 02:21:12.069933 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:12.069938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:12.070215 (+ 277us) server_negotiation.cc:407] Connection header received
0807 02:21:12.070377 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:12.070380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:12.070413 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:12.070507 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:12.071305 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:12.071309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:12.071312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:12.071324 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:12.071352 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:12.071371 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:12.071465 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:12.071541 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 02:21:12.071584 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 02:21:12.072691 31493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8: No bootstrap required, opened a new log
I20260807 02:21:12.076627 31493 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260807 02:21:12.076860 31493 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:12.076922 31493 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d20dc5f9d545f687b2f40cf142ffc8, State: Initialized, Role: FOLLOWER
I20260807 02:21:12.077358 31493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260807 02:21:12.077488 31493 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:12.077575 31493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:12.077706 31493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:12.078658 31493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260807 02:21:12.079064 31493 leader_election.cc:302] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85d20dc5f9d545f687b2f40cf142ffc8; no voters:
I20260807 02:21:12.079386 31493 leader_election.cc:288] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:12.079550 31509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:12.079834 31509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [term 1 LEADER]: Becoming Leader. State: Replica: 85d20dc5f9d545f687b2f40cf142ffc8, State: Running, Role: LEADER
I20260807 02:21:12.080160 31509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260807 02:21:12.080678 31493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:12.081996 31511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d20dc5f9d545f687b2f40cf142ffc8. Latest consensus state: current_term: 1 leader_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260807 02:21:12.082145 31511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:12.082526 31510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d20dc5f9d545f687b2f40cf142ffc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260807 02:21:12.082631 31510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8 [sys.catalog]: This master's current role is: LEADER
W20260807 02:21:12.085958 31532 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:12.086032 31532 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:12.086130 31524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:12.087036 31524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:12.093663 31524 catalog_manager.cc:1347] Generated new cluster ID: 38de44107f8e47a197ccf2bb2f415f49
I20260807 02:21:12.093752 31524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:12.103483 31524 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:12.103886 31524 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:12.113271 31524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85d20dc5f9d545f687b2f40cf142ffc8: Generated new TSK 0
I20260807 02:21:12.114073 31524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:12.123050 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 31399
2026-08-07T02:21:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1586 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:12 dist-test-slave-39l8 krb5kdc[31540](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:12 dist-test-slave-39l8 krb5kdc[31540](info): set up 2 sockets
Aug 07 02:21:12 dist-test-slave-39l8 krb5kdc[31540](info): commencing operation
krb5kdc: starting...
W20260807 02:21:13.346508 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:13 dist-test-slave-39l8 krb5kdc[31540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:13.487285 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32817
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:13.603662 31557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:13.603986 31557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:13.604065 31557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:13.608148 31557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:13.608245 31557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:13.608287 31557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:13.608345 31557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:13.608385 31557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:13.613757 31557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32817
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:13.614955 31557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:13.616076 31557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:13.625079 31568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:13.625238 31557 server_base.cc:1034] running on GCE node
W20260807 02:21:13.625033 31564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:13.625033 31565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:13.625943 31557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:13.627199 31557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:13.628371 31557 hybrid_clock.cc:648] HybridClock initialized: now 1786069273628337 us; error 51 us; skew 500 ppm
Aug 07 02:21:13 dist-test-slave-39l8 krb5kdc[31540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:13.631268 31557 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:13.632184 31557 webserver.cc:460] Webserver started at http://127.0.0.1:42201/ using document root <none> and password file <none>
I20260807 02:21:13.632728 31557 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:13.632788 31557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:13.632961 31557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:13.635092 31557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "7a1a0607727c4a73845d71072dabb524"
format_stamp: "Formatted at 2026-08-07 02:21:13 on dist-test-slave-39l8"
server_key: "fbdffc73b4c4e4d595c7b3618c859282"
server_key_iv: "a659c076a35cc3181ddca4eb4d4fc600"
server_key_version: "encryptionkey@0"
I20260807 02:21:13.635623 31557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "7a1a0607727c4a73845d71072dabb524"
format_stamp: "Formatted at 2026-08-07 02:21:13 on dist-test-slave-39l8"
server_key: "fbdffc73b4c4e4d595c7b3618c859282"
server_key_iv: "a659c076a35cc3181ddca4eb4d4fc600"
server_key_version: "encryptionkey@0"
I20260807 02:21:13.639448 31557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 02:21:13.641978 31577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:13.643389 31557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:21:13.643504 31557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "7a1a0607727c4a73845d71072dabb524"
format_stamp: "Formatted at 2026-08-07 02:21:13 on dist-test-slave-39l8"
server_key: "fbdffc73b4c4e4d595c7b3618c859282"
server_key_iv: "a659c076a35cc3181ddca4eb4d4fc600"
server_key_version: "encryptionkey@0"
I20260807 02:21:13.643649 31557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:13.670540 31557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:13.674283 31557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:13.674539 31557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:13.682696 31557 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32817
I20260807 02:21:13.682768 31644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32817 every 8 connection(s)
I20260807 02:21:13.683732 31557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:13.685704 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 31557
I20260807 02:21:13.685864 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:13.686187 1531 external_mini_cluster.cc:1428] Setting key d1f5d6599eeeceffbfed994ba6afb8a8
I20260807 02:21:13.686934 31645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:13.694304 31645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524: Bootstrap starting.
Aug 07 02:21:13 dist-test-slave-39l8 krb5kdc[31540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 02:21:13.696971 31645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:13.698055 31645 log.cc:824] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:13.700572 31645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524: No bootstrap required, opened a new log
I20260807 02:21:13.702284 31649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:13.687809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:39381 (local address 127.0.0.1:32817)
0807 02:21:13.688266 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:13.688290 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:13.688334 (+ 44us) server_negotiation.cc:407] Connection header received
0807 02:21:13.689220 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:13.689245 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:13.689710 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:13.690118 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:13.690891 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:13.692403 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:13.693309 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:13.693976 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:13.694161 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:13.696795 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:13.696804 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:13.696823 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:13.696864 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:13.698874 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:13.699393 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:13.699399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:13.699405 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:13.699544 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:13.699941 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:13.699945 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:13.699946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:13.700473 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:13.700704 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:13.701114 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 02:21:13.701347 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":133,"threads_started":1}
I20260807 02:21:13.705154 31645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1a0607727c4a73845d71072dabb524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32817 } }
I20260807 02:21:13.705382 31645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:13.705438 31645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1a0607727c4a73845d71072dabb524, State: Initialized, Role: FOLLOWER
I20260807 02:21:13.705722 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:13.705955 31645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1a0607727c4a73845d71072dabb524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32817 } }
I20260807 02:21:13.706116 31645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:13.706203 31645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:13.706326 31645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:13.707468 31645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1a0607727c4a73845d71072dabb524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32817 } }
I20260807 02:21:13.707844 31645 leader_election.cc:302] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a1a0607727c4a73845d71072dabb524; no voters:
I20260807 02:21:13.708232 31645 leader_election.cc:288] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:13.708645 31658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:13.708943 31658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [term 1 LEADER]: Becoming Leader. State: Replica: 7a1a0607727c4a73845d71072dabb524, State: Running, Role: LEADER
I20260807 02:21:13.709357 31658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1a0607727c4a73845d71072dabb524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32817 } }
I20260807 02:21:13.709647 31645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:13.711123 31660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a1a0607727c4a73845d71072dabb524. Latest consensus state: current_term: 1 leader_uuid: "7a1a0607727c4a73845d71072dabb524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1a0607727c4a73845d71072dabb524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32817 } } }
I20260807 02:21:13.711251 31660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:13.711601 31664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a1a0607727c4a73845d71072dabb524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a1a0607727c4a73845d71072dabb524" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32817 } } }
I20260807 02:21:13.711714 31664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524 [sys.catalog]: This master's current role is: LEADER
W20260807 02:21:13.715083 31681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:13.715200 31681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:13.715306 31677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:13.716075 31677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:13.717954 31649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:13.708053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:33765 (local address 127.0.0.1:32817)
0807 02:21:13.708205 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:13.708209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:13.708396 (+ 187us) server_negotiation.cc:407] Connection header received
0807 02:21:13.708531 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:13.708534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:13.708587 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:13.708675 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:13.709525 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:13.710304 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:13.711561 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:13.711935 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:13.712062 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:13.714023 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:13.714027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:13.714030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:13.714057 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:13.715832 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:13.716443 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:13.716447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:13.716449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:13.716540 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:13.716934 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:13.716938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:13.716939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:13.717183 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:13.717342 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:13.717679 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 02:21:13.717787 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:21:13.721976 31677 catalog_manager.cc:1347] Generated new cluster ID: 5cd06a75549c478e936c0946226fe05a
I20260807 02:21:13.722041 31677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:13.739073 31677 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:13.740445 31677 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:13.749982 31677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a1a0607727c4a73845d71072dabb524: Generated new TSK 0
I20260807 02:21:13.750952 31677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:13.757030 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 31557
W20260807 02:21:13.772243 31538 connection.cc:535] client connection to 127.0.0.1:32817 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32817): Connection reset by peer (error 104)
2026-08-07T02:21:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1638 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:13 dist-test-slave-39l8 krb5kdc[31691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:13 dist-test-slave-39l8 krb5kdc[31691](info): set up 2 sockets
Aug 07 02:21:13 dist-test-slave-39l8 krb5kdc[31691](info): commencing operation
krb5kdc: starting...
W20260807 02:21:14.980512 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:15 dist-test-slave-39l8 krb5kdc[31691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:15.118294 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40267
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:15.240783 31709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:15.241102 31709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:15.241148 31709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:15.245272 31709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:15.245357 31709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:15.245378 31709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:15.245395 31709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:15.245412 31709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:15.251075 31709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40267
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:15.252229 31709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:15.253284 31709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:15.262246 31717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:15.262642 31718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:15.262691 31720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:15.262730 31709 server_base.cc:1034] running on GCE node
I20260807 02:21:15.263356 31709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:15.264504 31709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:15.265712 31709 hybrid_clock.cc:648] HybridClock initialized: now 1786069275265695 us; error 31 us; skew 500 ppm
Aug 07 02:21:15 dist-test-slave-39l8 krb5kdc[31691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:15.273499 31709 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:15.274545 31709 webserver.cc:460] Webserver started at http://127.0.0.1:45183/ using document root <none> and password file <none>
I20260807 02:21:15.275190 31709 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:15.275259 31709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:15.275435 31709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:15.277527 31709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "130d122665c34416a71ed08a5406e63c"
format_stamp: "Formatted at 2026-08-07 02:21:15 on dist-test-slave-39l8"
server_key: "25388c414a4005a9a575572ba8dac35b"
server_key_iv: "2cbf17432a5903a274eaf8e4dc8616a4"
server_key_version: "encryptionkey@0"
I20260807 02:21:15.278069 31709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "130d122665c34416a71ed08a5406e63c"
format_stamp: "Formatted at 2026-08-07 02:21:15 on dist-test-slave-39l8"
server_key: "25388c414a4005a9a575572ba8dac35b"
server_key_iv: "2cbf17432a5903a274eaf8e4dc8616a4"
server_key_version: "encryptionkey@0"
I20260807 02:21:15.282008 31709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:21:15.284677 31730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:15.285919 31709 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:15.286062 31709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "130d122665c34416a71ed08a5406e63c"
format_stamp: "Formatted at 2026-08-07 02:21:15 on dist-test-slave-39l8"
server_key: "25388c414a4005a9a575572ba8dac35b"
server_key_iv: "2cbf17432a5903a274eaf8e4dc8616a4"
server_key_version: "encryptionkey@0"
I20260807 02:21:15.286187 31709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:15.298218 31709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:15.301502 31709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:15.301826 31709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:15.309638 31709 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40267
I20260807 02:21:15.309659 31810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40267 every 8 connection(s)
I20260807 02:21:15.310647 31709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:15.313689 31814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:15.317327 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 31709
I20260807 02:21:15.317487 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:15.317780 1531 external_mini_cluster.cc:1428] Setting key 0f12a66b606a2f838f5f7d0182f0e971
I20260807 02:21:15.320103 31814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c: Bootstrap starting.
I20260807 02:21:15.322628 31814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:15.323657 31814 log.cc:824] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:15.326267 31814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c: No bootstrap required, opened a new log
I20260807 02:21:15.328361 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:15.319404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:44935 (local address 127.0.0.1:40267)
0807 02:21:15.319866 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:15.319890 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:15.319942 (+ 52us) server_negotiation.cc:407] Connection header received
0807 02:21:15.320743 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:15.320764 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:15.321146 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:15.321450 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:15.321812 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:15.323026 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:15.324315 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:15.324961 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:15.325117 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:15.326163 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:15.326169 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:15.326185 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:15.326685 (+ 500us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:15.326800 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:15.326830 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:15.326944 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:15.327175 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 02:21:15.327341 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":140,"threads_started":1}
I20260807 02:21:15.329787 31814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "130d122665c34416a71ed08a5406e63c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40267 } }
I20260807 02:21:15.330077 31814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:15.330140 31814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130d122665c34416a71ed08a5406e63c, State: Initialized, Role: FOLLOWER
I20260807 02:21:15.330556 31814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "130d122665c34416a71ed08a5406e63c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40267 } }
I20260807 02:21:15.330760 31814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:15.330835 31814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:15.330941 31814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:15.331911 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:15.332197 31814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "130d122665c34416a71ed08a5406e63c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40267 } }
I20260807 02:21:15.332607 31814 leader_election.cc:302] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 130d122665c34416a71ed08a5406e63c; no voters:
I20260807 02:21:15.333004 31814 leader_election.cc:288] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:15.333122 31820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:15.333408 31820 raft_consensus.cc:686] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [term 1 LEADER]: Becoming Leader. State: Replica: 130d122665c34416a71ed08a5406e63c, State: Running, Role: LEADER
I20260807 02:21:15.333781 31820 consensus_queue.cc:237] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "130d122665c34416a71ed08a5406e63c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40267 } }
I20260807 02:21:15.334530 31814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:15.335273 31827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "130d122665c34416a71ed08a5406e63c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "130d122665c34416a71ed08a5406e63c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40267 } } }
I20260807 02:21:15.335428 31827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:15.335695 31827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 130d122665c34416a71ed08a5406e63c. Latest consensus state: current_term: 1 leader_uuid: "130d122665c34416a71ed08a5406e63c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "130d122665c34416a71ed08a5406e63c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40267 } } }
I20260807 02:21:15.335785 31827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:15.340103 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:15.334327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:38023 (local address 127.0.0.1:40267)
0807 02:21:15.334442 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:15.334445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:15.335002 (+ 557us) server_negotiation.cc:407] Connection header received
0807 02:21:15.335257 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:15.335262 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:15.335325 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:15.335383 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:15.335906 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:15.336703 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:15.338056 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:15.338361 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:15.338458 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:15.339555 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:15.339559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:15.339561 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:15.339577 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:15.339609 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:15.339622 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:15.339712 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:15.339905 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 02:21:15.339944 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260807 02:21:15.340556 31847 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:15.340646 31847 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:15.340749 31841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:15.341631 31841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:15.348397 31841 catalog_manager.cc:1347] Generated new cluster ID: 4267bbccbce84eb8be518e6ec6b47f28
I20260807 02:21:15.348495 31841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:15.355525 31841 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:15.356532 31841 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:15.366251 31841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 130d122665c34416a71ed08a5406e63c: Generated new TSK 0
I20260807 02:21:15.367090 31841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:15.376338 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 31709
W20260807 02:21:15.390241 31687 connection.cc:535] client connection to 127.0.0.1:40267 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40267): Connection reset by peer (error 104)
2026-08-07T02:21:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1618 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:15 dist-test-slave-39l8 krb5kdc[31855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:15 dist-test-slave-39l8 krb5kdc[31855](info): set up 2 sockets
Aug 07 02:21:15 dist-test-slave-39l8 krb5kdc[31855](info): commencing operation
krb5kdc: starting...
W20260807 02:21:16.614768 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:16 dist-test-slave-39l8 krb5kdc[31855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 02:21:16.745893 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:16.865769 31873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:16.866115 31873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:16.866204 31873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:16.870278 31873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:16.870394 31873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:16.870434 31873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:16.870486 31873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:16.870536 31873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:16.876418 31873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38797
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:16.877625 31873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:16.878696 31873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:16.888119 31879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:16.888230 31873 server_base.cc:1034] running on GCE node
W20260807 02:21:16.888195 31882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:16.888123 31885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:16.889045 31873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:16.890260 31873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:16.891424 31873 hybrid_clock.cc:648] HybridClock initialized: now 1786069276891392 us; error 45 us; skew 500 ppm
Aug 07 02:21:16 dist-test-slave-39l8 krb5kdc[31855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069276, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:16.894390 31873 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 02:21:16.895408 31873 webserver.cc:460] Webserver started at http://127.0.0.1:46045/ using document root <none> and password file <none>
I20260807 02:21:16.896025 31873 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:16.896092 31873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:16.896311 31873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:16.898448 31873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "db4c610bf5754a6688e8adf018ca12ea"
format_stamp: "Formatted at 2026-08-07 02:21:16 on dist-test-slave-39l8"
server_key: "9fa05e923fac1093d5b90960a53d2479"
server_key_iv: "4129ab68866d0126ffe457bbd55f079c"
server_key_version: "encryptionkey@0"
I20260807 02:21:16.899085 31873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "db4c610bf5754a6688e8adf018ca12ea"
format_stamp: "Formatted at 2026-08-07 02:21:16 on dist-test-slave-39l8"
server_key: "9fa05e923fac1093d5b90960a53d2479"
server_key_iv: "4129ab68866d0126ffe457bbd55f079c"
server_key_version: "encryptionkey@0"
I20260807 02:21:16.902976 31873 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:21:16.905395 31893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:16.906759 31873 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:16.906906 31873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "db4c610bf5754a6688e8adf018ca12ea"
format_stamp: "Formatted at 2026-08-07 02:21:16 on dist-test-slave-39l8"
server_key: "9fa05e923fac1093d5b90960a53d2479"
server_key_iv: "4129ab68866d0126ffe457bbd55f079c"
server_key_version: "encryptionkey@0"
I20260807 02:21:16.907021 31873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:16.911748 31873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:16.915300 31873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:16.915510 31873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:16.922916 31873 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38797
I20260807 02:21:16.922945 31969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38797 every 8 connection(s)
I20260807 02:21:16.923930 31873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:16.927099 31970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:16.933372 31970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea: Bootstrap starting.
I20260807 02:21:16.934125 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 31873
I20260807 02:21:16.934295 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:16.934643 1531 external_mini_cluster.cc:1428] Setting key b58a74b815863ab9ff93234a8f170e53
I20260807 02:21:16.936868 31970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:16.937703 31970 log.cc:824] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:16.940361 31970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea: No bootstrap required, opened a new log
I20260807 02:21:16.940548 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:16.936209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:44689 (local address 127.0.0.1:38797)
0807 02:21:16.936797 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:16.936813 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:16.936850 (+ 37us) server_negotiation.cc:407] Connection header received
0807 02:21:16.937572 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:16.937590 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:16.937936 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:16.938294 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:16.939125 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:16.939131 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:16.939146 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:16.939157 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:16.939220 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:16.939247 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:16.939357 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:16.939472 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 02:21:16.939633 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":181,"threads_started":1}
I20260807 02:21:16.943536 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:16.944579 31970 raft_consensus.cc:348] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db4c610bf5754a6688e8adf018ca12ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38797 } }
I20260807 02:21:16.944826 31970 raft_consensus.cc:374] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:16.944912 31970 raft_consensus.cc:729] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db4c610bf5754a6688e8adf018ca12ea, State: Initialized, Role: FOLLOWER
I20260807 02:21:16.945397 31970 consensus_queue.cc:260] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db4c610bf5754a6688e8adf018ca12ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38797 } }
I20260807 02:21:16.945546 31970 raft_consensus.cc:388] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:16.945629 31970 raft_consensus.cc:482] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:16.945741 31970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:16.946954 31970 raft_consensus.cc:504] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db4c610bf5754a6688e8adf018ca12ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38797 } }
I20260807 02:21:16.947347 31970 leader_election.cc:302] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db4c610bf5754a6688e8adf018ca12ea; no voters:
I20260807 02:21:16.947744 31970 leader_election.cc:288] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:16.947757 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:16.945823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:46485 (local address 127.0.0.1:38797)
0807 02:21:16.945948 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:16.945955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:16.946190 (+ 235us) server_negotiation.cc:407] Connection header received
0807 02:21:16.946279 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:16.946284 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:16.946322 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:16.946407 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:16.947276 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:16.947278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:16.947280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:16.947292 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:16.947317 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:16.947328 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:16.947403 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:16.947558 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 02:21:16.947604 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:21:16.947796 31983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:16.948043 31983 raft_consensus.cc:686] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [term 1 LEADER]: Becoming Leader. State: Replica: db4c610bf5754a6688e8adf018ca12ea, State: Running, Role: LEADER
I20260807 02:21:16.948400 31983 consensus_queue.cc:237] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db4c610bf5754a6688e8adf018ca12ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38797 } }
I20260807 02:21:16.949127 31970 sys_catalog.cc:564] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:16.949724 31983 sys_catalog.cc:455] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader db4c610bf5754a6688e8adf018ca12ea. Latest consensus state: current_term: 1 leader_uuid: "db4c610bf5754a6688e8adf018ca12ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db4c610bf5754a6688e8adf018ca12ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38797 } } }
I20260807 02:21:16.949852 31983 sys_catalog.cc:458] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:16.950165 31984 sys_catalog.cc:455] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db4c610bf5754a6688e8adf018ca12ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db4c610bf5754a6688e8adf018ca12ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38797 } } }
I20260807 02:21:16.950325 31984 sys_catalog.cc:458] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:16.950629 31990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:16.953553 31990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:16.959426 31990 catalog_manager.cc:1347] Generated new cluster ID: 6df4ded242074e00b60228f53e241f53
I20260807 02:21:16.959509 31990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:16.983345 31990 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:16.983747 31990 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:16.990664 31990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db4c610bf5754a6688e8adf018ca12ea: Generated new TSK 0
I20260807 02:21:16.991407 31990 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:16.995973 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 31873
2026-08-07T02:21:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1619 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:17 dist-test-slave-39l8 krb5kdc[32013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:17 dist-test-slave-39l8 krb5kdc[32013](info): set up 2 sockets
Aug 07 02:21:17 dist-test-slave-39l8 krb5kdc[32013](info): commencing operation
krb5kdc: starting...
W20260807 02:21:18.233805 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:18 dist-test-slave-39l8 krb5kdc[32013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:18.366410 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46623
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:34267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:46623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:18.485061 32029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:18.485360 32029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:18.485404 32029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:18.489462 32029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:18.489538 32029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:18.489558 32029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:18.489578 32029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:18.489593 32029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:18.495030 32029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:46623
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:46623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:18.496169 32029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:18.497188 32029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:18.506460 32037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:18.506503 32036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:18.506531 32039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:18.506479 32029 server_base.cc:1034] running on GCE node
I20260807 02:21:18.507352 32029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:18.508438 32029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:18.509651 32029 hybrid_clock.cc:648] HybridClock initialized: now 1786069278509632 us; error 31 us; skew 500 ppm
Aug 07 02:21:18 dist-test-slave-39l8 krb5kdc[32013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069278, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:18.512571 32029 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:18.513515 32029 webserver.cc:460] Webserver started at http://127.1.126.254:36661/ using document root <none> and password file <none>
I20260807 02:21:18.514123 32029 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:18.514189 32029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:18.514429 32029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:18.516579 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "96883ae3564645b7a60813d2fb28b87a"
format_stamp: "Formatted at 2026-08-07 02:21:18 on dist-test-slave-39l8"
server_key: "62acd5551297894a67b4f1ce435dc72a"
server_key_iv: "05b06ad3d396a28ad4ea5af98e79837a"
server_key_version: "encryptionkey@0"
I20260807 02:21:18.517148 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "96883ae3564645b7a60813d2fb28b87a"
format_stamp: "Formatted at 2026-08-07 02:21:18 on dist-test-slave-39l8"
server_key: "62acd5551297894a67b4f1ce435dc72a"
server_key_iv: "05b06ad3d396a28ad4ea5af98e79837a"
server_key_version: "encryptionkey@0"
I20260807 02:21:18.521351 32029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 02:21:18.523870 32047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:18.525199 32029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:21:18.525352 32029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "96883ae3564645b7a60813d2fb28b87a"
format_stamp: "Formatted at 2026-08-07 02:21:18 on dist-test-slave-39l8"
server_key: "62acd5551297894a67b4f1ce435dc72a"
server_key_iv: "05b06ad3d396a28ad4ea5af98e79837a"
server_key_version: "encryptionkey@0"
I20260807 02:21:18.525460 32029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:18.541391 32029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:18.544917 32029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:18.545095 32029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:18.552641 32029 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:46623
I20260807 02:21:18.552691 32114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:46623 every 8 connection(s)
I20260807 02:21:18.553678 32029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:18.553933 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 32029
I20260807 02:21:18.554090 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:18.554461 1531 external_mini_cluster.cc:1428] Setting key 4886ff7f38bda3604d9edbe46977ed00
I20260807 02:21:18.557227 32115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:18.564249 32115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a: Bootstrap starting.
Aug 07 02:21:18 dist-test-slave-39l8 krb5kdc[32013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:18.567281 32115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:18.568220 32115 log.cc:824] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:18.570663 32115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a: No bootstrap required, opened a new log
I20260807 02:21:18.570742 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:18.556040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34741 (local address 127.1.126.254:46623)
0807 02:21:18.556505 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:18.556522 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:18.556793 (+ 271us) server_negotiation.cc:407] Connection header received
0807 02:21:18.557602 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:18.557628 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:18.557972 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:18.558264 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:18.559250 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:18.560286 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:18.561467 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:18.561948 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:18.562071 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:18.565126 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:18.565133 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:18.565150 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:18.565186 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:18.567250 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:18.567860 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:18.567866 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:18.567872 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:18.568021 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:18.568367 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:18.568370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:18.568372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:18.568897 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:18.569071 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:18.569484 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 02:21:18.569747 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":140,"threads_started":1}
I20260807 02:21:18.573815 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:18.574939 32115 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96883ae3564645b7a60813d2fb28b87a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46623 } }
I20260807 02:21:18.575255 32115 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:18.575336 32115 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96883ae3564645b7a60813d2fb28b87a, State: Initialized, Role: FOLLOWER
I20260807 02:21:18.575826 32115 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96883ae3564645b7a60813d2fb28b87a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46623 } }
I20260807 02:21:18.576013 32115 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:18.576095 32115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:18.576218 32115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:18.577502 32115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96883ae3564645b7a60813d2fb28b87a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46623 } }
I20260807 02:21:18.577899 32115 leader_election.cc:302] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96883ae3564645b7a60813d2fb28b87a; no voters:
I20260807 02:21:18.578269 32115 leader_election.cc:288] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:18.578387 32125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:18.578663 32125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [term 1 LEADER]: Becoming Leader. State: Replica: 96883ae3564645b7a60813d2fb28b87a, State: Running, Role: LEADER
I20260807 02:21:18.579123 32125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96883ae3564645b7a60813d2fb28b87a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46623 } }
I20260807 02:21:18.579802 32115 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:18.580394 32125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96883ae3564645b7a60813d2fb28b87a. Latest consensus state: current_term: 1 leader_uuid: "96883ae3564645b7a60813d2fb28b87a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96883ae3564645b7a60813d2fb28b87a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46623 } } }
I20260807 02:21:18.580525 32125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:18.581260 32126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96883ae3564645b7a60813d2fb28b87a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96883ae3564645b7a60813d2fb28b87a" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 46623 } } }
I20260807 02:21:18.581372 32126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:18.582588 32132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:18.585834 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:18.576008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57677 (local address 127.1.126.254:46623)
0807 02:21:18.576135 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:18.576140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:18.576561 (+ 421us) server_negotiation.cc:407] Connection header received
0807 02:21:18.576686 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:18.576690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:18.576738 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:18.576822 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:18.577461 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:18.578246 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:18.579449 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:18.579894 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:18.580017 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:18.582036 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:18.582042 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:18.582048 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:18.582081 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:18.583834 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:18.584379 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:18.584382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:18.584384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:18.584472 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:18.584857 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:18.584860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:18.584862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:18.585076 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:18.585233 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:18.585583 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 02:21:18.585686 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 02:21:18.586338 32132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:18.592199 32132 catalog_manager.cc:1347] Generated new cluster ID: 0a859ed9cd62494a85347eee49c7a1f8
I20260807 02:21:18.592278 32132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:18.599421 32132 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:18.600361 32132 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:18.616266 32132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96883ae3564645b7a60813d2fb28b87a: Generated new TSK 0
I20260807 02:21:18.617029 32132 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:18.625347 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 32029
W20260807 02:21:18.640822 32011 connection.cc:535] client connection to 127.1.126.254:46623 recv error: Network error: failed to read from TLS socket (remote: 127.1.126.254:46623): Connection reset by peer (error 104)
2026-08-07T02:21:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:18 dist-test-slave-39l8 krb5kdc[32154](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:18 dist-test-slave-39l8 krb5kdc[32154](info): set up 2 sockets
Aug 07 02:21:18 dist-test-slave-39l8 krb5kdc[32154](info): commencing operation
krb5kdc: starting...
W20260807 02:21:19.855868 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:19 dist-test-slave-39l8 krb5kdc[32154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:19.985915 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:40493
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:37285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:40493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:20.104321 32176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:20.104676 32176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:20.104761 32176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:20.109004 32176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:20.109123 32176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:20.109172 32176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:20.109228 32176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:20.109282 32176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:20.115170 32176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:37285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:40493
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:40493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:20.116362 32176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:20.117448 32176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:20.127107 32185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:20.127142 32187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:20.127545 32184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:20.127785 32176 server_base.cc:1034] running on GCE node
I20260807 02:21:20.128331 32176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:20.129477 32176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:20.130656 32176 hybrid_clock.cc:648] HybridClock initialized: now 1786069280130625 us; error 41 us; skew 500 ppm
Aug 07 02:21:20 dist-test-slave-39l8 krb5kdc[32154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069280, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:20.133590 32176 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:20.134490 32176 webserver.cc:460] Webserver started at http://127.1.126.254:46443/ using document root <none> and password file <none>
I20260807 02:21:20.135103 32176 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:20.135174 32176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:20.135344 32176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:20.137357 32176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "7dc82afda7d84fa0a0058c0217ea5cb6"
format_stamp: "Formatted at 2026-08-07 02:21:20 on dist-test-slave-39l8"
server_key: "c11df4c2ad33d6ffd8f985fe728a9297"
server_key_iv: "4ae89698b70f66922ebe85b313cd78d2"
server_key_version: "encryptionkey@0"
I20260807 02:21:20.137876 32176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "7dc82afda7d84fa0a0058c0217ea5cb6"
format_stamp: "Formatted at 2026-08-07 02:21:20 on dist-test-slave-39l8"
server_key: "c11df4c2ad33d6ffd8f985fe728a9297"
server_key_iv: "4ae89698b70f66922ebe85b313cd78d2"
server_key_version: "encryptionkey@0"
I20260807 02:21:20.141595 32176 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 02:21:20.144121 32194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:20.145525 32176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 02:21:20.145665 32176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "7dc82afda7d84fa0a0058c0217ea5cb6"
format_stamp: "Formatted at 2026-08-07 02:21:20 on dist-test-slave-39l8"
server_key: "c11df4c2ad33d6ffd8f985fe728a9297"
server_key_iv: "4ae89698b70f66922ebe85b313cd78d2"
server_key_version: "encryptionkey@0"
I20260807 02:21:20.145800 32176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:20.175177 32176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:20.178452 32176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:20.178676 32176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:20.186327 32176 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:40493
I20260807 02:21:20.186339 32270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:40493 every 8 connection(s)
I20260807 02:21:20.187362 32176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:20.190264 32271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:20.193416 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 32176
I20260807 02:21:20.193559 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:20.193862 1531 external_mini_cluster.cc:1428] Setting key eb37dee88719fcd5f2d3afd458a0b8bd
I20260807 02:21:20.196458 32271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6: Bootstrap starting.
I20260807 02:21:20.198712 32271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:20.199523 32271 log.cc:824] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:20.201505 32271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6: No bootstrap required, opened a new log
I20260807 02:21:20.202872 32274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:20.195248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55973 (local address 127.1.126.254:40493)
0807 02:21:20.195716 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:20.195732 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:20.195767 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:21:20.196405 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:20.196422 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:20.196800 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:20.197128 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:20.197541 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:20.198506 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:20.199518 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:20.200025 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:20.200197 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:20.201118 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:20.201123 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:20.201137 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:20.201520 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:20.201574 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:20.201619 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:20.201790 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:20.201968 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 02:21:20.202109 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":128,"threads_started":1}
I20260807 02:21:20.205062 32271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 40493 } }
I20260807 02:21:20.205363 32271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:20.205448 32271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc82afda7d84fa0a0058c0217ea5cb6, State: Initialized, Role: FOLLOWER
I20260807 02:21:20.205879 32271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 40493 } }
I20260807 02:21:20.206003 32271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:20.206084 32271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:20.206213 32271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:20.206393 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:20.207455 32271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 40493 } }
I20260807 02:21:20.207851 32271 leader_election.cc:302] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dc82afda7d84fa0a0058c0217ea5cb6; no voters:
I20260807 02:21:20.208223 32271 leader_election.cc:288] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:20.208309 32283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:20.208551 32283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 7dc82afda7d84fa0a0058c0217ea5cb6, State: Running, Role: LEADER
I20260807 02:21:20.208931 32283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 40493 } }
I20260807 02:21:20.209621 32271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:20.210227 32285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dc82afda7d84fa0a0058c0217ea5cb6. Latest consensus state: current_term: 1 leader_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 40493 } } }
I20260807 02:21:20.210350 32285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:20.210750 32290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:20.210690 32286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dc82afda7d84fa0a0058c0217ea5cb6" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 40493 } } }
I20260807 02:21:20.210821 32286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:20.213995 32274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:20.209095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42581 (local address 127.1.126.254:40493)
0807 02:21:20.209226 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:20.209231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:20.209264 (+ 33us) server_negotiation.cc:407] Connection header received
0807 02:21:20.209300 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:20.209302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:20.209345 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:20.209424 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:20.209912 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:20.210687 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:20.212015 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:20.212352 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:20.212459 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:20.213438 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:20.213443 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:20.213446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:20.213466 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:20.213490 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:20.213501 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:20.213610 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:20.213834 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 02:21:20.213871 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 02:21:20.214233 32290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:20.220129 32290 catalog_manager.cc:1347] Generated new cluster ID: 8c35dd16896145afb0949304426be86c
I20260807 02:21:20.220214 32290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:20.237910 32290 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:20.239144 32290 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:20.246295 32290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7dc82afda7d84fa0a0058c0217ea5cb6: Generated new TSK 0
I20260807 02:21:20.247061 32290 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:20.252642 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 32176
W20260807 02:21:20.264843 32151 connection.cc:535] client connection to 127.1.126.254:40493 recv error: Network error: failed to read from TLS socket (remote: 127.1.126.254:40493): Connection reset by peer (error 104)
2026-08-07T02:21:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1623 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:20 dist-test-slave-39l8 krb5kdc[32310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:20 dist-test-slave-39l8 krb5kdc[32310](info): set up 2 sockets
Aug 07 02:21:20 dist-test-slave-39l8 krb5kdc[32310](info): commencing operation
krb5kdc: starting...
W20260807 02:21:21.459004 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:21 dist-test-slave-39l8 krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:21.591814 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37755
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:37755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:21.706830 32329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:21.707137 32329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:21.707219 32329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:21.711261 32329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:21.711344 32329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:21.711381 32329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:21.711434 32329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:21.711473 32329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:21.716866 32329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:37755
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:21.717965 32329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:21.719079 32329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:21.727620 32340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:21.727640 32338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:21.727696 32329 server_base.cc:1034] running on GCE node
W20260807 02:21:21.727682 32337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:21.728453 32329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:21.729585 32329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:21.730775 32329 hybrid_clock.cc:648] HybridClock initialized: now 1786069281730763 us; error 25 us; skew 500 ppm
Aug 07 02:21:21 dist-test-slave-39l8 krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:21.733480 32329 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:21.734366 32329 webserver.cc:460] Webserver started at http://127.1.126.254:46721/ using document root <none> and password file <none>
I20260807 02:21:21.734988 32329 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:21.735051 32329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:21.735265 32329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:21.737322 32329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "df6a156819b845c9ba40a095a4760b91"
format_stamp: "Formatted at 2026-08-07 02:21:21 on dist-test-slave-39l8"
server_key: "9f3463a5ed3061d0a2f430c1e207c135"
server_key_iv: "01be2b68247de903d5d774711803733b"
server_key_version: "encryptionkey@0"
I20260807 02:21:21.737895 32329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "df6a156819b845c9ba40a095a4760b91"
format_stamp: "Formatted at 2026-08-07 02:21:21 on dist-test-slave-39l8"
server_key: "9f3463a5ed3061d0a2f430c1e207c135"
server_key_iv: "01be2b68247de903d5d774711803733b"
server_key_version: "encryptionkey@0"
I20260807 02:21:21.741708 32329 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 02:21:21.744143 32349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:21.745334 32329 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 02:21:21.745462 32329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "df6a156819b845c9ba40a095a4760b91"
format_stamp: "Formatted at 2026-08-07 02:21:21 on dist-test-slave-39l8"
server_key: "9f3463a5ed3061d0a2f430c1e207c135"
server_key_iv: "01be2b68247de903d5d774711803733b"
server_key_version: "encryptionkey@0"
I20260807 02:21:21.745569 32329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:21.750241 32329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:21.753288 32329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:21.753479 32329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:21.760406 32329 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:37755
I20260807 02:21:21.760471 32426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:37755 every 8 connection(s)
I20260807 02:21:21.761335 32329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:21.764272 32428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:21.769423 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 32329
I20260807 02:21:21.769544 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:21.769826 1531 external_mini_cluster.cc:1428] Setting key b51e498fc71a4bfa88de1aebc82deb1f
I20260807 02:21:21.770097 32428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91: Bootstrap starting.
I20260807 02:21:21.772930 32428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:21.773864 32428 log.cc:824] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:21.775676 32433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:21.771294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34403 (local address 127.1.126.254:37755)
0807 02:21:21.771737 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:21.771756 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:21.771799 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:21:21.772632 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:21.772657 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:21.773024 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:21.773406 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:21.774174 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:21.774180 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:21.774197 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:21.774214 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:21.774284 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:21.774315 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:21.774416 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:21.774584 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 02:21:21.774768 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":117,"threads_started":1}
I20260807 02:21:21.776350 32428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91: No bootstrap required, opened a new log
I20260807 02:21:21.778599 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:21.780455 32428 raft_consensus.cc:348] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6a156819b845c9ba40a095a4760b91" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37755 } }
I20260807 02:21:21.780769 32428 raft_consensus.cc:374] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:21.780839 32428 raft_consensus.cc:729] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6a156819b845c9ba40a095a4760b91, State: Initialized, Role: FOLLOWER
I20260807 02:21:21.781407 32428 consensus_queue.cc:260] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6a156819b845c9ba40a095a4760b91" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37755 } }
I20260807 02:21:21.781580 32428 raft_consensus.cc:388] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:21.781672 32428 raft_consensus.cc:482] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:21.781777 32428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:21.782620 32433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:21.780816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53113 (local address 127.1.126.254:37755)
0807 02:21:21.780942 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:21.780946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:21.781220 (+ 274us) server_negotiation.cc:407] Connection header received
0807 02:21:21.781323 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:21.781326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:21.781365 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:21.781444 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:21.782253 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:21.782257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:21.782259 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:21.782271 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:21.782301 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:21.782314 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:21.782405 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:21.782459 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 02:21:21.782497 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 02:21:21.783078 32428 raft_consensus.cc:504] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6a156819b845c9ba40a095a4760b91" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37755 } }
I20260807 02:21:21.783432 32428 leader_election.cc:302] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df6a156819b845c9ba40a095a4760b91; no voters:
I20260807 02:21:21.783773 32428 leader_election.cc:288] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:21.783843 32441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:21.784055 32441 raft_consensus.cc:686] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [term 1 LEADER]: Becoming Leader. State: Replica: df6a156819b845c9ba40a095a4760b91, State: Running, Role: LEADER
I20260807 02:21:21.784355 32441 consensus_queue.cc:237] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6a156819b845c9ba40a095a4760b91" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37755 } }
I20260807 02:21:21.785146 32428 sys_catalog.cc:564] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:21.786207 32442 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df6a156819b845c9ba40a095a4760b91. Latest consensus state: current_term: 1 leader_uuid: "df6a156819b845c9ba40a095a4760b91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6a156819b845c9ba40a095a4760b91" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37755 } } }
I20260807 02:21:21.786207 32443 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df6a156819b845c9ba40a095a4760b91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df6a156819b845c9ba40a095a4760b91" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37755 } } }
I20260807 02:21:21.786366 32442 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:21.786391 32443 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:21.788076 32453 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:21.790676 32453 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:21.796731 32453 catalog_manager.cc:1347] Generated new cluster ID: 30bc57adeb3c4943b48275aedbb506b8
I20260807 02:21:21.796825 32453 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:21.804641 32453 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:21.804970 32453 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:21.809403 32453 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df6a156819b845c9ba40a095a4760b91: Generated new TSK 0
I20260807 02:21:21.810039 32453 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:21.818305 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 32329
2026-08-07T02:21:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1565 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:21 dist-test-slave-39l8 krb5kdc[32469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:21 dist-test-slave-39l8 krb5kdc[32469](info): set up 2 sockets
Aug 07 02:21:21 dist-test-slave-39l8 krb5kdc[32469](info): commencing operation
krb5kdc: starting...
W20260807 02:21:23.036780 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:23 dist-test-slave-39l8 krb5kdc[32469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:23.167027 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37555
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:37555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:23.282290 32484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:23.282573 32484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:23.282618 32484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:23.286696 32484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:23.286795 32484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:23.286815 32484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:23.286832 32484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:23.286847 32484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:23.292309 32484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:37555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:23.293447 32484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:23.294449 32484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:21:23.303385 32484 server_base.cc:1034] running on GCE node
W20260807 02:21:23.303423 32493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:23.303424 32491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:23.303587 32495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:23.304219 32484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:23.305353 32484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:23.306550 32484 hybrid_clock.cc:648] HybridClock initialized: now 1786069283306526 us; error 26 us; skew 500 ppm
Aug 07 02:21:23 dist-test-slave-39l8 krb5kdc[32469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069283, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:23.309348 32484 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:23.310253 32484 webserver.cc:460] Webserver started at http://127.1.126.254:38555/ using document root <none> and password file <none>
I20260807 02:21:23.310943 32484 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:23.311040 32484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:23.311277 32484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:23.313360 32484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "71d068a6b44b4fd69200c890ba143e00"
format_stamp: "Formatted at 2026-08-07 02:21:23 on dist-test-slave-39l8"
server_key: "859e04882d9d676b833b9e47f04de827"
server_key_iv: "6bca0e8504795de42041af02006bccab"
server_key_version: "encryptionkey@0"
I20260807 02:21:23.313962 32484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "71d068a6b44b4fd69200c890ba143e00"
format_stamp: "Formatted at 2026-08-07 02:21:23 on dist-test-slave-39l8"
server_key: "859e04882d9d676b833b9e47f04de827"
server_key_iv: "6bca0e8504795de42041af02006bccab"
server_key_version: "encryptionkey@0"
I20260807 02:21:23.317868 32484 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 02:21:23.320586 32507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:23.321882 32484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 02:21:23.322165 32484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "71d068a6b44b4fd69200c890ba143e00"
format_stamp: "Formatted at 2026-08-07 02:21:23 on dist-test-slave-39l8"
server_key: "859e04882d9d676b833b9e47f04de827"
server_key_iv: "6bca0e8504795de42041af02006bccab"
server_key_version: "encryptionkey@0"
I20260807 02:21:23.322290 32484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:23.345168 32484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:23.348573 32484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:23.348796 32484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:23.356395 32484 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:37555
I20260807 02:21:23.356419 32576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:37555 every 8 connection(s)
I20260807 02:21:23.357412 32484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:23.360291 32577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:23.364269 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 32484
I20260807 02:21:23.364423 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:23.364717 1531 external_mini_cluster.cc:1428] Setting key afb42ea207b74d41a911b46dda67c20d
I20260807 02:21:23.366135 32577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00: Bootstrap starting.
I20260807 02:21:23.368494 32577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:23.369257 32577 log.cc:824] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:23.371188 32577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00: No bootstrap required, opened a new log
Aug 07 02:21:23 dist-test-slave-39l8 krb5kdc[32469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:23.375448 32577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d068a6b44b4fd69200c890ba143e00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37555 } }
I20260807 02:21:23.375746 32577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:23.375810 32577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71d068a6b44b4fd69200c890ba143e00, State: Initialized, Role: FOLLOWER
I20260807 02:21:23.376281 32577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d068a6b44b4fd69200c890ba143e00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37555 } }
I20260807 02:21:23.376405 32577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:23.376487 32577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:23.376595 32577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:23.377969 32577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d068a6b44b4fd69200c890ba143e00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37555 } }
I20260807 02:21:23.378345 32577 leader_election.cc:302] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71d068a6b44b4fd69200c890ba143e00; no voters:
I20260807 02:21:23.378772 32577 leader_election.cc:288] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:23.378867 32582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:23.379161 32582 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [term 1 LEADER]: Becoming Leader. State: Replica: 71d068a6b44b4fd69200c890ba143e00, State: Running, Role: LEADER
I20260807 02:21:23.379520 32582 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d068a6b44b4fd69200c890ba143e00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37555 } }
I20260807 02:21:23.380177 32577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:23.380226 32580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:23.366172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56779 (local address 127.1.126.254:37555)
0807 02:21:23.366675 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:23.366693 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:23.366782 (+ 89us) server_negotiation.cc:407] Connection header received
0807 02:21:23.367452 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:23.367470 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:23.367821 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:23.368165 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:23.369037 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:23.370068 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:23.371003 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:23.371516 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:23.371689 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:23.374608 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:23.374614 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:23.374627 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:23.374657 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:23.376808 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:23.377310 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:23.377316 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:23.377321 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:23.377429 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:23.377759 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:23.377761 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:23.377762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:23.378238 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:23.378383 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:23.378770 (+ 387us) server_negotiation.cc:299] Negotiation successful
0807 02:21:23.379193 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":137,"threads_started":1}
I20260807 02:21:23.382129 32585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71d068a6b44b4fd69200c890ba143e00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d068a6b44b4fd69200c890ba143e00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37555 } } }
I20260807 02:21:23.382143 32584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71d068a6b44b4fd69200c890ba143e00. Latest consensus state: current_term: 1 leader_uuid: "71d068a6b44b4fd69200c890ba143e00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d068a6b44b4fd69200c890ba143e00" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37555 } } }
I20260807 02:21:23.382325 32585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:23.382359 32584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:23.383710 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 02:21:23.385608 32607 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:23.385691 32607 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:23.386029 32609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:23.387027 32609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:23.393200 32609 catalog_manager.cc:1347] Generated new cluster ID: 72f1fc0ffc0b4498b0c74a6ece059943
I20260807 02:21:23.393349 32609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:23.395570 32580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:23.385957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49149 (local address 127.1.126.254:37555)
0807 02:21:23.386070 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:23.386076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:23.386360 (+ 284us) server_negotiation.cc:407] Connection header received
0807 02:21:23.386487 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:23.386490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:23.386543 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:23.386642 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:23.387499 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:23.388268 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:23.389512 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:23.389859 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:23.389972 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:23.391729 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:23.391736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:23.391740 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:23.391769 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:23.393574 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:23.394087 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:23.394091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:23.394093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:23.394180 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:23.394498 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:23.394502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:23.394503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:23.394772 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:23.394882 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:23.395266 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 02:21:23.395396 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 02:21:23.428521 32609 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:23.429538 32609 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:23.439648 32609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71d068a6b44b4fd69200c890ba143e00: Generated new TSK 0
I20260807 02:21:23.440390 32609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:23.446377 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 32484
2026-08-07T02:21:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1629 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:23 dist-test-slave-39l8 krb5kdc[32629](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:23 dist-test-slave-39l8 krb5kdc[32629](info): set up 2 sockets
Aug 07 02:21:23 dist-test-slave-39l8 krb5kdc[32629](info): commencing operation
krb5kdc: starting...
W20260807 02:21:24.660063 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:24 dist-test-slave-39l8 krb5kdc[32629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:24.791927 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45533
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:34461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:24.907627 32647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:24.907914 32647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:24.907959 32647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:24.912022 32647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:24.912096 32647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:24.912117 32647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:24.912133 32647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:24.912149 32647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:24.917542 32647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:34461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:24.918680 32647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:24.919837 32647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:21:24.928761 32647 server_base.cc:1034] running on GCE node
W20260807 02:21:24.928715 32656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:24.928781 32653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:24.928717 32652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:24.929620 32647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:24.930867 32647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:24.932051 32647 hybrid_clock.cc:648] HybridClock initialized: now 1786069284932036 us; error 29 us; skew 500 ppm
Aug 07 02:21:24 dist-test-slave-39l8 krb5kdc[32629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069284, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:24.934996 32647 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:24.936000 32647 webserver.cc:460] Webserver started at http://127.1.126.254:37879/ using document root <none> and password file <none>
I20260807 02:21:24.936600 32647 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:24.936697 32647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:24.936944 32647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:24.939150 32647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "d1ea1e3725b54d80951476f9f4bf7346"
format_stamp: "Formatted at 2026-08-07 02:21:24 on dist-test-slave-39l8"
server_key: "124678ee0ffb322dfcf4430999f32d50"
server_key_iv: "5dab91fe376e8df9c190332872ea8c31"
server_key_version: "encryptionkey@0"
I20260807 02:21:24.939751 32647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "d1ea1e3725b54d80951476f9f4bf7346"
format_stamp: "Formatted at 2026-08-07 02:21:24 on dist-test-slave-39l8"
server_key: "124678ee0ffb322dfcf4430999f32d50"
server_key_iv: "5dab91fe376e8df9c190332872ea8c31"
server_key_version: "encryptionkey@0"
I20260807 02:21:24.943588 32647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:21:24.946097 32668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:24.947430 32647 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 02:21:24.947578 32647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "d1ea1e3725b54d80951476f9f4bf7346"
format_stamp: "Formatted at 2026-08-07 02:21:24 on dist-test-slave-39l8"
server_key: "124678ee0ffb322dfcf4430999f32d50"
server_key_iv: "5dab91fe376e8df9c190332872ea8c31"
server_key_version: "encryptionkey@0"
I20260807 02:21:24.947697 32647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:24.991876 32647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:24.995230 32647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:24.995455 32647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:25.003446 32647 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45533
I20260807 02:21:25.003473 32737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45533 every 8 connection(s)
I20260807 02:21:25.004505 32647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:25.007438 32738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:25.010564 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 32647
I20260807 02:21:25.010751 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:25.011054 1531 external_mini_cluster.cc:1428] Setting key 386c52c425d11807d6de6923b3d9077a
I20260807 02:21:25.013425 32738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346: Bootstrap starting.
I20260807 02:21:25.015861 32738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:25.016822 32738 log.cc:824] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:25.019091 32738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346: No bootstrap required, opened a new log
I20260807 02:21:25.020342 32742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:25.012579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38285 (local address 127.1.126.254:45533)
0807 02:21:25.013013 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:25.013038 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:25.013075 (+ 37us) server_negotiation.cc:407] Connection header received
0807 02:21:25.013760 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:25.013778 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:25.014115 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:25.014405 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:25.014833 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:25.015824 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:25.017105 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:25.017573 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:25.017702 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:25.018574 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:25.018579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:25.018592 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:25.019054 (+ 462us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:25.019109 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:25.019133 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:25.019274 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:25.019438 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 02:21:25.019646 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":143,"threads_started":1}
I20260807 02:21:25.022606 32738 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ea1e3725b54d80951476f9f4bf7346" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45533 } }
I20260807 02:21:25.022913 32738 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:25.023000 32738 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1ea1e3725b54d80951476f9f4bf7346, State: Initialized, Role: FOLLOWER
I20260807 02:21:25.023474 32738 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ea1e3725b54d80951476f9f4bf7346" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45533 } }
I20260807 02:21:25.023643 32738 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:25.023720 32738 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:25.023819 32738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:25.023887 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:25.024746 32738 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ea1e3725b54d80951476f9f4bf7346" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45533 } }
I20260807 02:21:25.025092 32738 leader_election.cc:302] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1ea1e3725b54d80951476f9f4bf7346; no voters:
I20260807 02:21:25.025455 32738 leader_election.cc:288] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:25.025550 32749 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:25.025797 32749 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [term 1 LEADER]: Becoming Leader. State: Replica: d1ea1e3725b54d80951476f9f4bf7346, State: Running, Role: LEADER
I20260807 02:21:25.026284 32749 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ea1e3725b54d80951476f9f4bf7346" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45533 } }
I20260807 02:21:25.026927 32738 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:25.027608 32752 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1ea1e3725b54d80951476f9f4bf7346. Latest consensus state: current_term: 1 leader_uuid: "d1ea1e3725b54d80951476f9f4bf7346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ea1e3725b54d80951476f9f4bf7346" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45533 } } }
I20260807 02:21:25.027755 32752 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:25.028116 32751 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1ea1e3725b54d80951476f9f4bf7346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ea1e3725b54d80951476f9f4bf7346" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45533 } } }
I20260807 02:21:25.028256 32751 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:25.028604 32762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:25.031142 32742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:25.026088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55875 (local address 127.1.126.254:45533)
0807 02:21:25.026286 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:25.026290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:25.026525 (+ 235us) server_negotiation.cc:407] Connection header received
0807 02:21:25.026670 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:25.026673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:25.026756 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:25.026883 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:25.027178 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:25.027968 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:25.029244 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:25.029631 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:25.029735 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:25.030669 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:25.030673 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:25.030676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:25.030689 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:25.030740 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:25.030756 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:25.030838 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:25.030948 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 02:21:25.031003 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260807 02:21:25.032408 32762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:25.037849 32762 catalog_manager.cc:1347] Generated new cluster ID: 9f5e270f8fff4cd3a8b82d4afede6804
I20260807 02:21:25.037916 32762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:25.045835 32762 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:25.046859 32762 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:25.055467 32762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1ea1e3725b54d80951476f9f4bf7346: Generated new TSK 0
I20260807 02:21:25.056203 32762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:25.065441 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 32647
2026-08-07T02:21:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1616 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:25 dist-test-slave-39l8 krb5kdc[309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:25 dist-test-slave-39l8 krb5kdc[309](info): set up 2 sockets
Aug 07 02:21:25 dist-test-slave-39l8 krb5kdc[309](info): commencing operation
krb5kdc: starting...
W20260807 02:21:26.345674 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:26 dist-test-slave-39l8 krb5kdc[309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:26.475001 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45725
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:44433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:26.588666 330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:26.588925 330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:26.588969 330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:26.593031 330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:26.593092 330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:26.593112 330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:26.593171 330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:26.593205 330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:26.598389 330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:44433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:26.599558 330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:26.600584 330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:26.609094 336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:26.609119 340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:26.609211 330 server_base.cc:1034] running on GCE node
W20260807 02:21:26.609134 338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:26.609932 330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:26.611104 330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:26.612329 330 hybrid_clock.cc:648] HybridClock initialized: now 1786069286612303 us; error 38 us; skew 500 ppm
Aug 07 02:21:26 dist-test-slave-39l8 krb5kdc[309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:26.615177 330 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:26.616025 330 webserver.cc:460] Webserver started at http://127.1.126.254:36221/ using document root <none> and password file <none>
I20260807 02:21:26.616588 330 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:26.616680 330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:26.616909 330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:26.618985 330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "8a3101eeb2064dba840a09bdaf89197c"
format_stamp: "Formatted at 2026-08-07 02:21:26 on dist-test-slave-39l8"
server_key: "b9f9d7605d982181c0c29442dd326f4b"
server_key_iv: "0fb3ac1275a8ff9b7ce19f427db36488"
server_key_version: "encryptionkey@0"
I20260807 02:21:26.619565 330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "8a3101eeb2064dba840a09bdaf89197c"
format_stamp: "Formatted at 2026-08-07 02:21:26 on dist-test-slave-39l8"
server_key: "b9f9d7605d982181c0c29442dd326f4b"
server_key_iv: "0fb3ac1275a8ff9b7ce19f427db36488"
server_key_version: "encryptionkey@0"
I20260807 02:21:26.623380 330 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:21:26.625770 352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:26.626989 330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:21:26.627164 330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "8a3101eeb2064dba840a09bdaf89197c"
format_stamp: "Formatted at 2026-08-07 02:21:26 on dist-test-slave-39l8"
server_key: "b9f9d7605d982181c0c29442dd326f4b"
server_key_iv: "0fb3ac1275a8ff9b7ce19f427db36488"
server_key_version: "encryptionkey@0"
I20260807 02:21:26.627279 330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:26.631834 330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:26.634970 330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:26.635192 330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:26.642432 330 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45725
I20260807 02:21:26.642513 422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45725 every 8 connection(s)
I20260807 02:21:26.643482 330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:26.646306 423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:26.651810 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 330
I20260807 02:21:26.651865 423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c: Bootstrap starting.
I20260807 02:21:26.651978 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:26.652271 1531 external_mini_cluster.cc:1428] Setting key 93d3fd4a77b20babeae8be68f7184561
I20260807 02:21:26.654507 423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:26.655372 423 log.cc:824] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:26.657724 423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c: No bootstrap required, opened a new log
I20260807 02:21:26.657749 428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:26.653558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44031 (local address 127.1.126.254:45725)
0807 02:21:26.654003 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:26.654017 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:26.654052 (+ 35us) server_negotiation.cc:407] Connection header received
0807 02:21:26.654797 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:26.654817 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:26.655095 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:26.655375 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:26.656287 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:26.656296 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:26.656316 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:26.656333 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:26.656399 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:26.656426 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:26.656541 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:26.656724 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 02:21:26.656877 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":143,"threads_started":1}
I20260807 02:21:26.660610 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:26.662878 423 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3101eeb2064dba840a09bdaf89197c" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45725 } }
I20260807 02:21:26.663254 423 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 02:21:26.663336 423 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3101eeb2064dba840a09bdaf89197c, State: Initialized, Role: FOLLOWER
I20260807 02:21:26.663880 423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3101eeb2064dba840a09bdaf89197c" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45725 } }
I20260807 02:21:26.664078 423 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 02:21:26.664179 423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 02:21:26.664287 423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:26.665050 428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:26.663102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40269 (local address 127.1.126.254:45725)
0807 02:21:26.663251 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:26.663256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:26.663467 (+ 211us) server_negotiation.cc:407] Connection header received
0807 02:21:26.663598 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:26.663601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:26.663645 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:26.663734 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:26.664645 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:26.664649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:26.664651 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 02:21:26.664664 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:26.664693 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 02:21:26.664710 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:26.664803 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:26.664883 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 02:21:26.664924 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 02:21:26.665370 423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3101eeb2064dba840a09bdaf89197c" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45725 } }
I20260807 02:21:26.665742 423 leader_election.cc:302] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a3101eeb2064dba840a09bdaf89197c; no voters:
I20260807 02:21:26.666127 423 leader_election.cc:288] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 02:21:26.666211 441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:26.666393 441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [term 1 LEADER]: Becoming Leader. State: Replica: 8a3101eeb2064dba840a09bdaf89197c, State: Running, Role: LEADER
I20260807 02:21:26.666692 441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3101eeb2064dba840a09bdaf89197c" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45725 } }
I20260807 02:21:26.667516 423 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:26.668460 442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a3101eeb2064dba840a09bdaf89197c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3101eeb2064dba840a09bdaf89197c" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45725 } } }
I20260807 02:21:26.668602 442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:26.668962 443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a3101eeb2064dba840a09bdaf89197c. Latest consensus state: current_term: 1 leader_uuid: "8a3101eeb2064dba840a09bdaf89197c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3101eeb2064dba840a09bdaf89197c" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45725 } } }
I20260807 02:21:26.669096 443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:26.669006 452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:26.672462 452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:26.678885 452 catalog_manager.cc:1347] Generated new cluster ID: 91d71e6aa9294b01951a52d68afc10d2
I20260807 02:21:26.678974 452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:26.695281 452 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:26.695685 452 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:26.703886 452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a3101eeb2064dba840a09bdaf89197c: Generated new TSK 0
I20260807 02:21:26.704638 452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 02:21:26.709372 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 330
2026-08-07T02:21:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1645 ms)
[----------] 18 tests from AuthTokenIssuingTest (28983 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:26 dist-test-slave-39l8 krb5kdc[469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:26 dist-test-slave-39l8 krb5kdc[469](info): set up 2 sockets
Aug 07 02:21:26 dist-test-slave-39l8 krb5kdc[469](info): commencing operation
krb5kdc: starting...
W20260807 02:21:27.926384 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:28.059687 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37175
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:37175,127.1.126.253:46741,127.1.126.252:40701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:28.179036 489 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 02:21:28.179390 489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:28.179462 489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:28.179544 489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:28.183580 489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:28.183697 489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:28.183749 489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:28.183787 489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:28.183820 489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:28.189280 489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:37175,127.1.126.253:46741,127.1.126.252:40701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:37175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:28.190515 489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:28.191613 489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:28.200517 499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:28.200523 498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:28.200606 489 server_base.cc:1034] running on GCE node
W20260807 02:21:28.200536 503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:28.201524 489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:28.202857 489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:28.204084 489 hybrid_clock.cc:648] HybridClock initialized: now 1786069288204052 us; error 44 us; skew 500 ppm
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:28.207093 489 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:28.208052 489 webserver.cc:460] Webserver started at http://127.1.126.254:44821/ using document root <none> and password file <none>
I20260807 02:21:28.208655 489 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:28.208719 489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:28.208981 489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:28.211229 489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "5189c333f38b4b87be301ef61a31e446"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "1ecefe802e09ba9ced42ee1ab889dd1f"
server_key_iv: "7f9aae53de17ed31539b622326b7066a"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.211860 489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "5189c333f38b4b87be301ef61a31e446"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "1ecefe802e09ba9ced42ee1ab889dd1f"
server_key_iv: "7f9aae53de17ed31539b622326b7066a"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.215894 489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:21:28.218537 513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:28.219905 489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:21:28.220063 489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "5189c333f38b4b87be301ef61a31e446"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "1ecefe802e09ba9ced42ee1ab889dd1f"
server_key_iv: "7f9aae53de17ed31539b622326b7066a"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.220192 489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:28.235786 489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:28.239475 489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:28.239715 489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:28.247603 489 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:37175
I20260807 02:21:28.247908 579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:37175 every 8 connection(s)
I20260807 02:21:28.248724 489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:28.251835 581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:28.256484 581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.257838 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 489
I20260807 02:21:28.257985 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:28.258281 1531 external_mini_cluster.cc:1428] Setting key 34e4d4aa042390b6c768c43092a3f735
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.126.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.253@KRBTEST.COM" created.
I20260807 02:21:28.273584 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.259545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44998 (local address 127.1.126.254:37175)
0807 02:21:28.260201 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.260223 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.260430 (+ 207us) server_negotiation.cc:407] Connection header received
0807 02:21:28.261501 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.261505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.261694 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.261889 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.262851 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.263834 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.264808 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.265185 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.265425 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.268180 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.268187 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.268198 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.268224 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.270078 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.270684 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.270693 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.270695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.270860 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.271195 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.271198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.271200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.271621 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.271770 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.272185 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.272477 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":420,"spinlock_wait_cycles":54528,"thread_start_us":178,"threads_started":1}
I20260807 02:21:28.273588 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.259545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:37175 (local address 127.0.0.1:44998)
0807 02:21:28.260241 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.260292 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.261176 (+ 884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.261888 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.261893 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.262374 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.262627 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.262641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.263956 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.263960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.264683 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.264692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.265347 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.265351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.265540 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.266247 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.266264 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.268012 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.270206 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.270221 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.270236 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.270539 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.270967 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.270971 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.270973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.271092 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.271749 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.271755 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.271903 (+ 148us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.272097 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.272527 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":189,"thread_start_us":179,"threads_started":1}
I20260807 02:21:28.276448 581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.277385 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.277094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44896)
0807 02:21:28.277231 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.277316 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 02:21:28.277666 517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
I20260807 02:21:28.278792 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.278451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44908)
0807 02:21:28.278607 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.278661 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 02:21:28.279091 581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:46741: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab.
Entry for principal kudu/127.1.126.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab.
I20260807 02:21:28.287727 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:46741
--webserver_interface=127.1.126.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab
--principal=kudu/127.1.126.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:37175,127.1.126.253:46741,127.1.126.252:40701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:21:28.328482 581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } attempt: 1
I20260807 02:21:28.329512 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.329194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44922)
0807 02:21:28.329364 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.329430 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 02:21:28.330346 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.330091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44932)
0807 02:21:28.330232 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.330286 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 02:21:28.330480 581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:46741: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
I20260807 02:21:28.398648 581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } attempt: 2
I20260807 02:21:28.399627 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.399331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44940)
0807 02:21:28.399481 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.399551 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 02:21:28.400465 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.400218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44952)
0807 02:21:28.400351 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.400406 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 02:21:28.400622 581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:46741: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
W20260807 02:21:28.406107 592 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 02:21:28.406466 592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:28.406530 592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:28.406638 592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:28.410892 592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:28.410983 592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:28.411020 592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:28.411057 592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:28.411098 592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:28.416821 592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:37175,127.1.126.253:46741,127.1.126.252:40701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab
--principal=kudu/127.1.126.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:46741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.126.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:28.418082 592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:28.419274 592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:28.428409 610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:28.428467 592 server_base.cc:1034] running on GCE node
W20260807 02:21:28.428365 605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:28.428387 607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:28.429270 592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:28.430404 592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:28.431571 592 hybrid_clock.cc:648] HybridClock initialized: now 1786069288431556 us; error 41 us; skew 500 ppm
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:28.434434 592 init.cc:377] Logged in from keytab as kudu/127.1.126.253@KRBTEST.COM (short username kudu)
I20260807 02:21:28.435463 592 webserver.cc:460] Webserver started at http://127.1.126.253:40765/ using document root <none> and password file <none>
I20260807 02:21:28.436056 592 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:28.436152 592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:28.436394 592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:28.438514 592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data/instance:
uuid: "96a30af2556f46babe13644824f4cfaa"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "cab89a6a0745c327394869d41382c1aa"
server_key_iv: "bab342bb6bcf166ca8b61de26e9c6891"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.439168 592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal/instance:
uuid: "96a30af2556f46babe13644824f4cfaa"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "cab89a6a0745c327394869d41382c1aa"
server_key_iv: "bab342bb6bcf166ca8b61de26e9c6891"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.443037 592 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:21:28.445622 620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:28.446964 592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:21:28.447103 592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal
uuid: "96a30af2556f46babe13644824f4cfaa"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "cab89a6a0745c327394869d41382c1aa"
server_key_iv: "bab342bb6bcf166ca8b61de26e9c6891"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.447219 592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:28.488919 592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:28.491807 581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } attempt: 3
I20260807 02:21:28.492204 592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:28.492405 592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:28.492625 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.492354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44962)
0807 02:21:28.492478 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.492542 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 02:21:28.493414 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.493148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44968)
0807 02:21:28.493289 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.493344 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 02:21:28.493602 581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:46741: Network error: Client connection negotiation failed: client connection to 127.1.126.253:46741: connect: Connection refused (error 111)
I20260807 02:21:28.499617 592 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.253:46741
I20260807 02:21:28.499919 694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.253:46741 every 8 connection(s)
I20260807 02:21:28.500589 592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
I20260807 02:21:28.503481 695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:28.506233 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 592
I20260807 02:21:28.506381 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-1/wal/instance
I20260807 02:21:28.506680 1531 external_mini_cluster.cc:1428] Setting key e092b0402d6fe90d136243fe39a8eb80
I20260807 02:21:28.507791 695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.126.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.252@KRBTEST.COM" created.
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:28.523959 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.510037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45012 (local address 127.1.126.254:37175)
0807 02:21:28.510201 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.510206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.511090 (+ 884us) server_negotiation.cc:407] Connection header received
0807 02:21:28.512124 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.512127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.512195 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.512298 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.513426 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.514313 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.515563 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.515947 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.516083 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.519773 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.519780 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.519787 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.519824 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.521421 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.522078 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.522081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.522082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.522157 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.522556 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.522559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.522560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.522816 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.522897 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.523617 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.523777 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 02:21:28.525264 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.510433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:37175 (local address 127.0.0.1:45012)
0807 02:21:28.510923 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.510976 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.511881 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.512461 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.512467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.512807 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.513275 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.513287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.514462 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.514465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.515437 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.515447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.516134 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.516139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.516298 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.516933 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.516960 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.519580 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.521547 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.521554 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.521573 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.521967 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.522250 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.522256 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.522261 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.522456 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.522924 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.522934 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.523308 (+ 374us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.523526 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.524020 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":138,"threads_started":1}
I20260807 02:21:28.526868 695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab.
Entry for principal kudu/127.1.126.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab.
I20260807 02:21:28.535797 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:40701
--webserver_interface=127.1.126.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab
--principal=kudu/127.1.126.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:37175,127.1.126.253:46741,127.1.126.252:40701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:21:28.537343 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.527483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44976)
0807 02:21:28.527621 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.527638 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.527729 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.528483 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.528486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.528631 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.528733 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.528738 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.529831 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.529834 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.530421 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.530431 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.531276 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.531279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.531412 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.531874 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.531889 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.533181 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.535397 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.535401 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.535403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.535687 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.536002 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.536008 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.536012 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.536122 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.536626 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.536632 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.536757 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.536878 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.537067 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 02:21:28.537408 700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.527599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44976 (local address 127.1.126.253:46741)
0807 02:21:28.527992 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.528006 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.528033 (+ 27us) server_negotiation.cc:407] Connection header received
0807 02:21:28.528088 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.528097 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.528337 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.528483 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.528855 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.529711 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.530552 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.531146 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.531251 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.533344 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.533353 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.533366 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.533387 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.535290 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.535803 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.535808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.535810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.535885 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.536235 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.536238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.536239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.536503 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.536616 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.536988 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.537151 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":170,"threads_started":1}
I20260807 02:21:28.539723 695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.540571 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.540217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54264)
0807 02:21:28.540378 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.540475 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 02:21:28.540809 622 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
I20260807 02:21:28.541751 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.541472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54272)
0807 02:21:28.541601 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.541667 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 02:21:28.541909 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:40701: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
I20260807 02:21:28.591226 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } attempt: 1
I20260807 02:21:28.592238 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.591856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54284)
0807 02:21:28.592055 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.592134 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 02:21:28.593161 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.592918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54290)
0807 02:21:28.593042 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.593098 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 02:21:28.593353 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:40701: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
I20260807 02:21:28.636780 581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } attempt: 4
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
I20260807 02:21:28.647285 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.637447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44986)
0807 02:21:28.637712 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.637732 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.637857 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.638151 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.638155 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.638375 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.638517 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.638525 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.639766 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.639770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.641142 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.641156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.641648 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.641652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.641781 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.642343 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.642359 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.643893 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.645678 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.645682 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.645685 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.645895 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.646203 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.646207 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.646208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.646296 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.646701 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.646720 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.646833 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.646946 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.647095 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260807 02:21:28.647285 700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.637499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44986 (local address 127.1.126.253:46741)
0807 02:21:28.637641 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.637648 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.637816 (+ 168us) server_negotiation.cc:407] Connection header received
0807 02:21:28.637969 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.637972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.638022 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.638089 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.638647 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.639634 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.641273 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.641517 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.641598 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.644050 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.644053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.644055 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.644082 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.645555 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.646014 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.646018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.646019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.646096 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.646395 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.646398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.646400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.646595 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.646736 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.647002 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.647121 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:21:28.648252 581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.648968 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.648727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54298)
0807 02:21:28.648848 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.648908 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 02:21:28.649596 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.649388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54302)
0807 02:21:28.649492 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.649538 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 02:21:28.649744 581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:40701: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
W20260807 02:21:28.658133 701 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 02:21:28.658509 701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:28.658572 701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:28.658664 701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 02:21:28.661545 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } attempt: 2
I20260807 02:21:28.662487 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.662162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54314)
0807 02:21:28.662336 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.662405 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 02:21:28.663305 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.663091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54324)
0807 02:21:28.663204 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.663252 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 02:21:28.663326 701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:28.663415 701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:28.663458 701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:28.663489 701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:28.663487 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:40701: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
W20260807 02:21:28.663527 701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:28.669152 701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:37175,127.1.126.253:46741,127.1.126.252:40701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab
--principal=kudu/127.1.126.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:40701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.126.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:28.670357 701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:28.671500 701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:28.680322 712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:28.680332 709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:28.680325 710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:28.680385 701 server_base.cc:1034] running on GCE node
I20260807 02:21:28.681200 701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:28.682399 701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:28.683597 701 hybrid_clock.cc:648] HybridClock initialized: now 1786069288683560 us; error 53 us; skew 500 ppm
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:28.686496 701 init.cc:377] Logged in from keytab as kudu/127.1.126.252@KRBTEST.COM (short username kudu)
I20260807 02:21:28.687516 701 webserver.cc:460] Webserver started at http://127.1.126.252:36873/ using document root <none> and password file <none>
I20260807 02:21:28.688077 701 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:28.688139 701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:28.688323 701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:28.690407 701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data/instance:
uuid: "d33848beb62746a0ae8216495c84bb3e"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "cf6e25f8b0d63555b21745101fc2c18d"
server_key_iv: "34d013fe8d64c3fbfe38b10d3a1682d0"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.691082 701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal/instance:
uuid: "d33848beb62746a0ae8216495c84bb3e"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "cf6e25f8b0d63555b21745101fc2c18d"
server_key_iv: "34d013fe8d64c3fbfe38b10d3a1682d0"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.695178 701 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 02:21:28.697861 721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:28.699309 701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:21:28.699432 701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal
uuid: "d33848beb62746a0ae8216495c84bb3e"
format_stamp: "Formatted at 2026-08-07 02:21:28 on dist-test-slave-39l8"
server_key: "cf6e25f8b0d63555b21745101fc2c18d"
server_key_iv: "34d013fe8d64c3fbfe38b10d3a1682d0"
server_key_version: "encryptionkey@0"
I20260807 02:21:28.699536 701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:28.708920 581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } attempt: 1
I20260807 02:21:28.709923 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.709582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54340)
0807 02:21:28.709765 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.709835 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 02:21:28.710850 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.710521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54346)
0807 02:21:28.710674 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.710788 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 02:21:28.710994 581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:40701: Network error: Client connection negotiation failed: client connection to 127.1.126.252:40701: connect: Connection refused (error 111)
I20260807 02:21:28.734174 701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:28.737411 701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:28.737648 701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:28.745350 701 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.252:40701
I20260807 02:21:28.745669 803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.252:40701 every 8 connection(s)
I20260807 02:21:28.746464 701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
I20260807 02:21:28.749567 804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:28.753712 804 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.754650 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } attempt: 3
I20260807 02:21:28.755323 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 701
I20260807 02:21:28.755465 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786069003535869-1531-0/minicluster-data/master-2/wal/instance
I20260807 02:21:28.755765 1531 external_mini_cluster.cc:1428] Setting key e5440fd29afc1f7f983d6f3a35e8eba7
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
I20260807 02:21:28.769237 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.755263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54358)
0807 02:21:28.755488 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.755506 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.755618 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.758391 (+ 2773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.758394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.758614 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.758761 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.758771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.760385 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.760389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.761225 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.761238 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.761881 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.761885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.761967 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.762727 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.762746 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.764265 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.766958 (+ 2693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.766960 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.766962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.767169 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.767647 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.767655 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.767657 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.767774 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.768654 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.768658 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.768777 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.768880 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.769040 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260807 02:21:28.770149 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.755877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45016 (local address 127.1.126.254:37175)
0807 02:21:28.756000 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.756005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.757048 (+ 1043us) server_negotiation.cc:407] Connection header received
0807 02:21:28.758071 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.758074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.758144 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.758249 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.759417 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.760142 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.761596 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.761919 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.762033 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.765747 (+ 3714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.765753 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.765759 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.765792 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.767652 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.768271 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.768276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.768283 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.768363 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.768702 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.768706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.768708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.768954 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.769027 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.769838 (+ 811us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.769970 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 02:21:28.771119 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.756384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54372 (local address 127.1.126.252:40701)
0807 02:21:28.757188 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.757197 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.757207 (+ 10us) server_negotiation.cc:407] Connection header received
0807 02:21:28.757867 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.757900 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.758167 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.758368 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.759426 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.760173 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.761107 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.761646 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.761800 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.765598 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.765604 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.765609 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.765639 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.768216 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.768729 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.768732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.768734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.768814 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.769102 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.769106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.769108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.769277 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.769633 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.770213 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.770346 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":754,"thread_start_us":80,"threads_started":1}
I20260807 02:21:28.771123 810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.756049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54358 (local address 127.1.126.252:40701)
0807 02:21:28.757151 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.757163 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.757206 (+ 43us) server_negotiation.cc:407] Connection header received
0807 02:21:28.757868 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.757900 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.758167 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.758881 (+ 714us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.758985 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.760279 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.761399 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.761741 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.762226 (+ 485us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.764437 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.764448 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.764468 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.764503 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.766633 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.767341 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.767352 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.767361 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.767524 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.767877 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.767883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.767889 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.768513 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.768673 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.769582 (+ 909us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.769956 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":198,"server-negotiator.queue_time_us":976,"spinlock_wait_cycles":39808,"thread_start_us":238,"threads_started":1}
I20260807 02:21:28.771123 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.756051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:37175 (local address 127.0.0.1:45016)
0807 02:21:28.756885 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.756931 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.757847 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.758307 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.758313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.758872 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.759250 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.759265 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.760281 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.760285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.761465 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.761473 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.762086 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.762091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.762237 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.762910 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.762927 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.765569 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.767774 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.767785 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.767791 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.768147 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.768459 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.768464 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.768466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.768560 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.769117 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.769125 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.769580 (+ 455us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.769756 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.770010 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"mutex_wait_us":178,"spinlock_wait_cycles":3712,"thread_start_us":169,"threads_started":1}
I20260807 02:21:28.772912 804 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.775781 695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: Bootstrap starting.
I20260807 02:21:28.778138 581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } attempt: 2
I20260807 02:21:28.778774 695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:28.779778 695 log.cc:824] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: Log is configured to *not* fsync() on all Append() calls
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:28.782177 695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: No bootstrap required, opened a new log
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
I20260807 02:21:28.785418 700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.773795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44988 (local address 127.1.126.253:46741)
0807 02:21:28.773936 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.773940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.775068 (+ 1128us) server_negotiation.cc:407] Connection header received
0807 02:21:28.775255 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.775258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.775307 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.775396 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.775913 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.776628 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.777692 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.777983 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.778059 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.780534 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.780538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.780541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.780571 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.783430 (+ 2859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.783947 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.783952 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.783954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.784042 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.784370 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.784374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.784375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.784624 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.784702 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.785110 (+ 408us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.785248 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 02:21:28.786164 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.773533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:46741 (local address 127.0.0.1:44988)
0807 02:21:28.774993 (+ 1460us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.775008 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.775132 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.775431 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.775436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.775624 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.775772 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.775783 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.776768 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.776772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.777552 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.777564 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.778227 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.778230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.778328 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.778810 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.778826 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.780371 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.783545 (+ 3174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.783549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.783551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.783818 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.784157 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.784160 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.784163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.784264 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.784784 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.784787 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.784921 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.785842 (+ 921us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.786001 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1391}
I20260807 02:21:28.786878 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.774854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45018 (local address 127.1.126.254:37175)
0807 02:21:28.774973 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.774977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.774990 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:21:28.775081 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.775087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.775139 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.775213 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.776117 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.776623 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.777452 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.777684 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.777790 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.781569 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.781573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.781576 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.781601 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.784324 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.784840 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.784845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.784848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.784931 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.785262 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.785266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.785267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.785519 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.785756 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.786536 (+ 780us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.786658 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 02:21:28.786827 695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.787123 695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a30af2556f46babe13644824f4cfaa, State: Initialized, Role: FOLLOWER
I20260807 02:21:28.787247 804 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:28.787533 695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.789184 815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.789245 695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:28.789418 815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:28.790452 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.779049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54388)
0807 02:21:28.779158 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.779172 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.779253 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.779727 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.779730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.779918 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.780018 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.780026 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.781108 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.781112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.781913 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.781932 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.782909 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.782913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.783013 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.783453 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.783472 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.785116 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.787201 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.787204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.787206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.787445 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.787854 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.787857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.787860 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.787950 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.789972 (+ 2022us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.789975 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.790075 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.790163 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.790295 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 02:21:28.791038 810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.778916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54388 (local address 127.1.126.252:40701)
0807 02:21:28.779480 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.779484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.779498 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:21:28.779537 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.779540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.779580 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.780147 (+ 567us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.780268 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.780975 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.782059 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.782760 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.783228 (+ 468us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.785267 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.785271 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.785275 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.785298 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.787081 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.787589 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.787592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.787594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.787744 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.788072 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.788075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.788080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.788296 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.790651 (+ 2355us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.790761 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.790882 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487}
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
I20260807 02:21:28.794693 581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446: Bootstrap starting.
W20260807 02:21:28.795500 831 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:28.795578 831 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:28.793253 592 master_runner.cc:186] Error getting master registration for 127.1.126.254:37175: OK, instance_id { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" instance_seqno: 1786069288245310 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 02:21:28.796449 592 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 02:21:28.797451 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.787712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:40701 (local address 127.0.0.1:54402)
0807 02:21:28.788171 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:28.788185 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:28.788271 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:28.788721 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:28.788726 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:28.788906 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:28.789002 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.789010 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.789918 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.789924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.791079 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:28.791093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.791717 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.791720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:28.791795 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.792352 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:28.792370 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:28.793863 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:28.795924 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.795927 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.795929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.796190 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.796464 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:28.796467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:28.796469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:28.796543 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:28.796944 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:28.796946 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:28.797020 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 02:21:28.797141 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 02:21:28.797278 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":140,"threads_started":1}
I20260807 02:21:28.797909 581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:28.797943 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.788024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54402 (local address 127.1.126.252:40701)
0807 02:21:28.788453 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.788458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.788469 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:21:28.788499 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.788501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.788552 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.788625 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.789118 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.789805 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.791213 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.791518 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.791614 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.793999 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.794003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.794005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.794026 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.795799 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.796295 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.796300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.796303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.796378 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.796629 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.796632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.796634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.796825 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.796912 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.797654 (+ 742us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.797779 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352}
I20260807 02:21:28.799449 581 log.cc:824] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446: Log is configured to *not* fsync() on all Append() calls
Aug 07 02:21:28 dist-test-slave-39l8 krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
I20260807 02:21:28.801182 804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: Bootstrap starting.
I20260807 02:21:28.802074 581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446: No bootstrap required, opened a new log
I20260807 02:21:28.804270 804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:28.805142 700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.788551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44996 (local address 127.1.126.253:46741)
0807 02:21:28.788661 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.788665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.788779 (+ 114us) server_negotiation.cc:407] Connection header received
0807 02:21:28.788889 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.788892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.788934 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.789010 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.789883 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.790612 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.796772 (+ 6160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.797099 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.797454 (+ 355us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.800701 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.800705 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.800707 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.800737 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.802471 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.803066 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.803070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.803072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.803166 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.803670 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.803673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.803675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.803910 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.804104 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.804837 (+ 733us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.804961 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 02:21:28.805593 804 log.cc:824] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:28.806691 581 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.807029 581 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5189c333f38b4b87be301ef61a31e446, State: Initialized, Role: FOLLOWER
I20260807 02:21:28.807399 581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.807945 836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.808156 836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:28.808946 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:28.808933 581 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:28.810412 543 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5189c333f38b4b87be301ef61a31e446"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018
I20260807 02:21:28.810793 543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 02:21:28.810935 543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:28.812120 543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.813218 543 leader_election.cc:288] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [CANDIDATE]: Term 1 election: Requested vote from peers 96a30af2556f46babe13644824f4cfaa (127.1.126.253:46741), d33848beb62746a0ae8216495c84bb3e (127.1.126.252:40701)
I20260807 02:21:28.813833 658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5189c333f38b4b87be301ef61a31e446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "96a30af2556f46babe13644824f4cfaa"
I20260807 02:21:28.814103 658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:28.815639 658 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5189c333f38b4b87be301ef61a31e446 in term 1.
W20260807 02:21:28.816761 849 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:28.816829 849 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:28.817435 517 leader_election.cc:302] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5189c333f38b4b87be301ef61a31e446, 96a30af2556f46babe13644824f4cfaa; no voters:
I20260807 02:21:28.817739 836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:28.817934 836 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [term 1 LEADER]: Becoming Leader. State: Replica: 5189c333f38b4b87be301ef61a31e446, State: Running, Role: LEADER
I20260807 02:21:28.818287 836 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.820173 836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5189c333f38b4b87be301ef61a31e446. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.820293 836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:28.827138 804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: No bootstrap required, opened a new log
I20260807 02:21:28.824465 489 master_runner.cc:186] Error getting master registration for 127.1.126.252:40701: OK, instance_id { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" instance_seqno: 1786069288743032 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 02:21:28.828081 489 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 02:21:28.828449 864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:28.829552 864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:28.830107 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.817184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45034 (local address 127.1.126.254:37175)
0807 02:21:28.817321 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.817325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.817339 (+ 14us) server_negotiation.cc:407] Connection header received
0807 02:21:28.817379 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.817382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.817425 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.817510 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.819241 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.819994 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.821897 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.822259 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.822339 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.825486 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.825491 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.825494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.825531 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.827512 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.828330 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.828334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.828336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.828426 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.828894 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.828900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.828901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.829136 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.829256 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.829800 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.829939 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 02:21:28.831574 804 raft_consensus.cc:348] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.831876 804 raft_consensus.cc:729] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d33848beb62746a0ae8216495c84bb3e, State: Initialized, Role: FOLLOWER
I20260807 02:21:28.832278 804 consensus_queue.cc:260] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } }
I20260807 02:21:28.833458 865 sys_catalog.cc:455] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.833750 865 sys_catalog.cc:458] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:28.833810 804 sys_catalog.cc:564] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:28.833904 763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5189c333f38b4b87be301ef61a31e446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d33848beb62746a0ae8216495c84bb3e"
I20260807 02:21:28.834260 763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:28.835784 763 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5189c333f38b4b87be301ef61a31e446 in term 1.
I20260807 02:21:28.839697 658 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [term 1 FOLLOWER]: Refusing update from remote peer 5189c333f38b4b87be301ef61a31e446: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:21:28.840621 836 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:21:28.842868 810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.816483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54414 (local address 127.1.126.252:40701)
0807 02:21:28.816617 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.816624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.823013 (+ 6389us) server_negotiation.cc:407] Connection header received
0807 02:21:28.823230 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.823235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.823293 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.823359 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.825859 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.826721 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.829860 (+ 3139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.830189 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.830272 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.837345 (+ 7073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.837349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.837352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.837386 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.839303 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.839808 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.839815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.839820 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.839936 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.840919 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.840925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.840929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.841179 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.841304 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.842513 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.842668 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 02:21:28.844422 700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:28.816781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45012 (local address 127.1.126.253:46741)
0807 02:21:28.816942 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.816946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.824337 (+ 7391us) server_negotiation.cc:407] Connection header received
0807 02:21:28.824550 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.824554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.824612 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.824670 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.828035 (+ 3365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.828775 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.830997 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:28.831374 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:28.831462 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:28.839945 (+ 8483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:28.839949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:28.839952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:28.839988 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:28.841977 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.842673 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.842677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.842679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.842813 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:28.843425 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:28.843428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:28.843430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:28.843672 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:28.843790 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:28.844160 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 02:21:28.844283 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 02:21:28.839380 763 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [term 1 FOLLOWER]: Refusing update from remote peer 5189c333f38b4b87be301ef61a31e446: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:21:28.849545 836 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:21:28.854205 865 sys_catalog.cc:455] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5189c333f38b4b87be301ef61a31e446. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.854388 865 sys_catalog.cc:458] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:28.856647 815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5189c333f38b4b87be301ef61a31e446. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.856781 815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: This master's current role is: FOLLOWER
W20260807 02:21:28.859952 890 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:28.860268 890 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:28.860675 861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.860841 861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:28.862242 892 mvcc.cc:205] Tried to move back new op lower bound from 7315739807076564992 to 7315739807003230208. Current Snapshot: MvccSnapshot[applied={T|T < 7315739807076564992}]
I20260807 02:21:28.865751 865 sys_catalog.cc:455] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.865886 865 sys_catalog.cc:458] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:28.866053 867 mvcc.cc:205] Tried to move back new op lower bound from 7315739807076564992 to 7315739807003230208. Current Snapshot: MvccSnapshot[applied={T|T < 7315739807076564992}]
I20260807 02:21:28.872628 864 catalog_manager.cc:1347] Generated new cluster ID: e2ee2ff2097e4af99d67ec645c48b041
I20260807 02:21:28.872731 864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:28.897025 864 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:28.898458 864 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:28.906109 836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.906288 836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:28.908063 891 mvcc.cc:205] Tried to move back new op lower bound from 7315739807076564992 to 7315739807003230208. Current Snapshot: MvccSnapshot[applied={T|T < 7315739807076564992}]
I20260807 02:21:28.908723 815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5189c333f38b4b87be301ef61a31e446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5189c333f38b4b87be301ef61a31e446" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 37175 } } peers { permanent_uuid: "96a30af2556f46babe13644824f4cfaa" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 46741 } } peers { permanent_uuid: "d33848beb62746a0ae8216495c84bb3e" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 40701 } } }
I20260807 02:21:28.908850 815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:28.926486 864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5189c333f38b4b87be301ef61a31e446: Generated new TSK 0
I20260807 02:21:28.930018 864 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 02:21:28.970348 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:28.966781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45024 (local address 127.1.126.253:46741)
0807 02:21:28.966929 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.966934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.969066 (+ 2132us) server_negotiation.cc:407] Connection header received
0807 02:21:28.969329 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.969334 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.969392 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.969452 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.970190 (+ 738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45024: BlockingRecv error: recv got EOF from 127.0.0.1:45024 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 02:21:28.971993 588 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:28.967715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.1.126.254:37175)
0807 02:21:28.967840 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.967845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.970941 (+ 3096us) server_negotiation.cc:407] Connection header received
0807 02:21:28.971155 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.971159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.971231 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.971292 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.971861 (+ 569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45042: BlockingRecv error: recv got EOF from 127.0.0.1:45042 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 02:21:28.973587 810 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:28.968428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54420 (local address 127.1.126.252:40701)
0807 02:21:28.968550 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.968554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.972583 (+ 4029us) server_negotiation.cc:407] Connection header received
0807 02:21:28.972784 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.972788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.972845 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.972903 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.973458 (+ 555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54420: BlockingRecv error: recv got EOF from 127.0.0.1:54420 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 02:21:28.979544 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:28.977494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45032 (local address 127.1.126.253:46741)
0807 02:21:28.977627 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.977632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.978254 (+ 622us) server_negotiation.cc:407] Connection header received
0807 02:21:28.978520 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.978524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.978666 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.978780 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.979420 (+ 640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45032: BlockingRecv error: recv got EOF from 127.0.0.1:45032 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 02:21:28.985268 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:28.983514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.1.126.253:46741)
0807 02:21:28.983630 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.983634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.984218 (+ 584us) server_negotiation.cc:407] Connection header received
0807 02:21:28.984440 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.984444 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.984500 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.984557 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.985140 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45042: BlockingRecv error: recv got EOF from 127.0.0.1:45042 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 02:21:28.996091 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:28.989662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45050 (local address 127.1.126.253:46741)
0807 02:21:28.989814 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:28.989818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:28.995093 (+ 5275us) server_negotiation.cc:407] Connection header received
0807 02:21:28.995315 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:28.995319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:28.995373 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:28.995424 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:28.995973 (+ 549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45050: BlockingRecv error: recv got EOF from 127.0.0.1:45050 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 02:21:29.004418 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.002444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.1.126.253:46741)
0807 02:21:29.002583 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.002588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.003233 (+ 645us) server_negotiation.cc:407] Connection header received
0807 02:21:29.003440 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.003444 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.003513 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.003566 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.004301 (+ 735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45060: BlockingRecv error: recv got EOF from 127.0.0.1:45060 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 02:21:29.017055 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.015303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.1.126.253:46741)
0807 02:21:29.015428 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.015432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.016040 (+ 608us) server_negotiation.cc:407] Connection header received
0807 02:21:29.016264 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.016268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.016324 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.016378 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.016933 (+ 555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45070: BlockingRecv error: recv got EOF from 127.0.0.1:45070 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 02:21:29.037108 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.035528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45086 (local address 127.1.126.253:46741)
0807 02:21:29.035669 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.035674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.035987 (+ 313us) server_negotiation.cc:407] Connection header received
0807 02:21:29.036215 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.036219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.036279 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.036370 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.036939 (+ 569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45086: BlockingRecv error: recv got EOF from 127.0.0.1:45086 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 02:21:29.072890 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.071526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.1.126.253:46741)
0807 02:21:29.071715 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.071719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.071792 (+ 73us) server_negotiation.cc:407] Connection header received
0807 02:21:29.071930 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.071933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.071984 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.072112 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.072755 (+ 643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45096: BlockingRecv error: recv got EOF from 127.0.0.1:45096 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260807 02:21:29.140486 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.139378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.1.126.253:46741)
0807 02:21:29.139549 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.139552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.139603 (+ 51us) server_negotiation.cc:407] Connection header received
0807 02:21:29.139750 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.139753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.139800 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.139877 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.140352 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45108: BlockingRecv error: recv got EOF from 127.0.0.1:45108 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 02:21:29.272153 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.270984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.1.126.253:46741)
0807 02:21:29.271152 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.271156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.271265 (+ 109us) server_negotiation.cc:407] Connection header received
0807 02:21:29.271393 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.271396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.271445 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.271534 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.271963 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45110: BlockingRecv error: recv got EOF from 127.0.0.1:45110 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 02:21:29.531810 700 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:29.530495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.1.126.253:46741)
0807 02:21:29.530671 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:29.530676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:29.530825 (+ 149us) server_negotiation.cc:407] Connection header received
0807 02:21:29.531020 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:29.531022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:29.531075 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:29.531169 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:29.531664 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45124: BlockingRecv error: recv got EOF from 127.0.0.1:45124 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 02:21:29.797238 831 catalog_manager.cc:1259] Loaded cluster ID: e2ee2ff2097e4af99d67ec645c48b041
I20260807 02:21:29.797335 831 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: loading cluster ID for follower catalog manager: success
I20260807 02:21:29.799465 831 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: acquiring CA information for follower catalog manager: success
I20260807 02:21:29.800841 831 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 96a30af2556f46babe13644824f4cfaa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 02:21:29.861739 890 catalog_manager.cc:1259] Loaded cluster ID: e2ee2ff2097e4af99d67ec645c48b041
I20260807 02:21:29.861840 890 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: loading cluster ID for follower catalog manager: success
I20260807 02:21:29.863591 890 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: acquiring CA information for follower catalog manager: success
I20260807 02:21:29.864851 890 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d33848beb62746a0ae8216495c84bb3e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 02:21:30.050724 989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:30.046529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45130 (local address 127.1.126.253:46741)
0807 02:21:30.046851 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:30.046856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:30.046872 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:21:30.047019 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:30.047023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:30.047171 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:30.047298 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:30.047586 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.048133 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.049047 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.049285 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.049400 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:30.049746 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:30.050261 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:30.050426 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:30.050462 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 02:21:30.050523 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":85,"threads_started":1}
I20260807 02:21:30.058331 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:30.054424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54430 (local address 127.1.126.252:40701)
0807 02:21:30.054699 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:30.054763 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:30.054785 (+ 22us) server_negotiation.cc:407] Connection header received
0807 02:21:30.054892 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:30.054894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:30.055023 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:30.055171 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:30.055410 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.055965 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.056837 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.057113 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.057210 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:30.057516 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:30.057974 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:30.058111 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:30.058140 (+ 29us) server_negotiation.cc:299] Negotiation successful
0807 02:21:30.058194 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
I20260807 02:21:30.066053 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:30.062244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54442 (local address 127.1.126.252:40701)
0807 02:21:30.062385 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:30.062389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:30.062400 (+ 11us) server_negotiation.cc:407] Connection header received
0807 02:21:30.062442 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:30.062444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:30.062497 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:30.062567 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:30.062998 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.063745 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.064764 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.065012 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.065115 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:30.065480 (+ 365us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:30.065572 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:30.065620 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:30.065800 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 02:21:30.065882 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 02:21:30.066366 989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:30.061781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45132 (local address 127.1.126.253:46741)
0807 02:21:30.062301 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:30.062305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:30.062322 (+ 17us) server_negotiation.cc:407] Connection header received
0807 02:21:30.062379 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:30.062383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:30.062443 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:30.062530 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:30.062792 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.063633 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.065079 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.065320 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.065445 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:30.065704 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:30.065814 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:30.065884 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:30.066165 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 02:21:30.066234 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390}
I20260807 02:21:30.066937 1002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:30.061696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45048 (local address 127.1.126.254:37175)
0807 02:21:30.061959 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:30.061964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:30.062326 (+ 362us) server_negotiation.cc:407] Connection header received
0807 02:21:30.062526 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:30.062530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:30.062766 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:30.062888 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:30.063126 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.063671 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.065051 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:30.065387 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:30.065485 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:30.065953 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:30.066325 (+ 372us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:30.066431 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:30.066730 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 02:21:30.066797 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":76,"threads_started":1}
I20260807 02:21:30.070412 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 489
I20260807 02:21:30.085631 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 592
I20260807 02:21:30.104404 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 701
2026-08-07T02:21:30Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3397 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 02:21:30 dist-test-slave-39l8 krb5kdc[1008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 02:21:30 dist-test-slave-39l8 krb5kdc[1008](info): set up 2 sockets
Aug 07 02:21:30 dist-test-slave-39l8 krb5kdc[1008](info): commencing operation
krb5kdc: starting...
W20260807 02:21:31.332913 1531 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/test-user.keytab.
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T02:21:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T02:21:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.126.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
Entry for principal kudu/127.1.126.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab.
I20260807 02:21:31.467875 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45753
--webserver_interface=127.1.126.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45753,127.1.126.253:42871,127.1.126.252:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 02:21:31.587798 1030 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 02:21:31.588174 1030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:31.588228 1030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:31.588304 1030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:31.592417 1030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:31.592523 1030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:31.592562 1030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:31.592605 1030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:31.592641 1030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:31.598269 1030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45753,127.1.126.253:42871,127.1.126.252:36059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.254.keytab
--principal=kudu/127.1.126.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.254:45753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.126.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:31.599510 1030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:31.600584 1030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 02:21:31.610070 1030 server_base.cc:1034] running on GCE node
W20260807 02:21:31.610003 1040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:31.610008 1042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:31.610002 1044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:31.611100 1030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:31.612262 1030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:31.613458 1030 hybrid_clock.cc:648] HybridClock initialized: now 1786069291613445 us; error 34 us; skew 500 ppm
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:31.620107 1030 init.cc:377] Logged in from keytab as kudu/127.1.126.254@KRBTEST.COM (short username kudu)
I20260807 02:21:31.621171 1030 webserver.cc:460] Webserver started at http://127.1.126.254:36159/ using document root <none> and password file <none>
I20260807 02:21:31.621742 1030 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:31.621805 1030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:31.621980 1030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:31.624193 1030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data/instance:
uuid: "c2b6e9ab3238444a9597163050205ce3"
format_stamp: "Formatted at 2026-08-07 02:21:31 on dist-test-slave-39l8"
server_key: "ed069caeddd12a3d63b6f37b89dcb3e5"
server_key_iv: "13a0bf56929579f3b632768909e7a354"
server_key_version: "encryptionkey@0"
I20260807 02:21:31.624747 1030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal/instance:
uuid: "c2b6e9ab3238444a9597163050205ce3"
format_stamp: "Formatted at 2026-08-07 02:21:31 on dist-test-slave-39l8"
server_key: "ed069caeddd12a3d63b6f37b89dcb3e5"
server_key_iv: "13a0bf56929579f3b632768909e7a354"
server_key_version: "encryptionkey@0"
I20260807 02:21:31.628748 1030 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 02:21:31.631315 1053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:31.632611 1030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 02:21:31.632771 1030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal
uuid: "c2b6e9ab3238444a9597163050205ce3"
format_stamp: "Formatted at 2026-08-07 02:21:31 on dist-test-slave-39l8"
server_key: "ed069caeddd12a3d63b6f37b89dcb3e5"
server_key_iv: "13a0bf56929579f3b632768909e7a354"
server_key_version: "encryptionkey@0"
I20260807 02:21:31.632886 1030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:31.661427 1030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:31.665025 1030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:31.665254 1030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:31.673142 1030 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.254:45753
I20260807 02:21:31.673447 1124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.254:45753 every 8 connection(s)
I20260807 02:21:31.674209 1030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/data/info.pb
I20260807 02:21:31.676465 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 1030
I20260807 02:21:31.676596 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-0/wal/instance
I20260807 02:21:31.676939 1531 external_mini_cluster.cc:1428] Setting key c72cb684f7fb0017499cd951a3f699cf
I20260807 02:21:31.677592 1125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:31.681928 1125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.126.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.253@KRBTEST.COM" created.
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:31.698348 1128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.684448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54710 (local address 127.1.126.254:45753)
0807 02:21:31.685004 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:31.685027 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:31.685312 (+ 285us) server_negotiation.cc:407] Connection header received
0807 02:21:31.686423 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:31.686428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:31.686677 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:31.686888 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:31.687714 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.688757 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.689720 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.690208 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.690397 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.692902 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:31.692913 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:31.692932 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:31.692964 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:31.695138 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.695665 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.695675 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.695677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.695832 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.696198 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.696202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.696204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.696768 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:31.696932 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:31.697302 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 02:21:31.697577 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":361,"spinlock_wait_cycles":2432,"thread_start_us":151,"threads_started":1}
I20260807 02:21:31.698356 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.684448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45753 (local address 127.0.0.1:54710)
0807 02:21:31.685124 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.685174 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:31.686130 (+ 956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:31.686934 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:31.686938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:31.687302 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:31.687559 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.687572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.688894 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.688897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.689596 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.689605 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.690382 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.690385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.690488 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.691152 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:31.691170 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:31.692692 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:31.695284 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.695292 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.695301 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.695547 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.695960 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.695962 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.695964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.696083 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.696896 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:31.696901 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:31.697037 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 02:21:31.697188 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 02:21:31.697467 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"spinlock_wait_cycles":17152,"thread_start_us":165,"threads_started":1}
I20260807 02:21:31.700947 1125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:31.701701 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.701436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35120)
0807 02:21:31.701562 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.701636 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 02:21:31.701916 1055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
I20260807 02:21:31.702829 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.702577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35134)
0807 02:21:31.702723 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.702774 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 02:21:31.702996 1125 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:42871: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab.
Entry for principal kudu/127.1.126.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab.
I20260807 02:21:31.705219 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:42871
--webserver_interface=127.1.126.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab
--principal=kudu/127.1.126.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45753,127.1.126.253:42871,127.1.126.252:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 02:21:31.752233 1125 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } attempt: 1
I20260807 02:21:31.753221 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.752838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35146)
0807 02:21:31.753031 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.753113 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 02:21:31.754022 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.753784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35150)
0807 02:21:31.753900 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.753955 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 02:21:31.754175 1125 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:42871: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
I20260807 02:21:31.822359 1125 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } attempt: 2
I20260807 02:21:31.823328 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.822979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35152)
0807 02:21:31.823156 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.823233 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 02:21:31.824110 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.823871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35166)
0807 02:21:31.823990 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.824046 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 02:21:31.824276 1125 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.253:42871: Network error: Client connection negotiation failed: client connection to 127.1.126.253:42871: connect: Connection refused (error 111)
W20260807 02:21:31.824188 1133 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 02:21:31.824599 1133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:31.824646 1133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:31.824715 1133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:31.828948 1133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:31.829015 1133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:31.829034 1133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:31.829052 1133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:31.829105 1133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:31.834808 1133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45753,127.1.126.253:42871,127.1.126.252:36059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.253.keytab
--principal=kudu/127.1.126.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.253:42871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.126.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:31.835973 1133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:31.837083 1133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:31.846261 1145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:31.846279 1143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:31.846261 1142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:31.846546 1133 server_base.cc:1034] running on GCE node
I20260807 02:21:31.847256 1133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:31.848424 1133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:31.849637 1133 hybrid_clock.cc:648] HybridClock initialized: now 1786069291849591 us; error 59 us; skew 500 ppm
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:31.852726 1133 init.cc:377] Logged in from keytab as kudu/127.1.126.253@KRBTEST.COM (short username kudu)
I20260807 02:21:31.853765 1133 webserver.cc:460] Webserver started at http://127.1.126.253:43119/ using document root <none> and password file <none>
I20260807 02:21:31.854393 1133 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:31.854493 1133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:31.854812 1133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:31.857062 1133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data/instance:
uuid: "ef9e75da134d43609cde080ba735a309"
format_stamp: "Formatted at 2026-08-07 02:21:31 on dist-test-slave-39l8"
server_key: "5bd176fdb8ae4f9ad0e51e753f1939f3"
server_key_iv: "fb0033d3d948f1f8ec47cbbe497f4536"
server_key_version: "encryptionkey@0"
I20260807 02:21:31.857722 1133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal/instance:
uuid: "ef9e75da134d43609cde080ba735a309"
format_stamp: "Formatted at 2026-08-07 02:21:31 on dist-test-slave-39l8"
server_key: "5bd176fdb8ae4f9ad0e51e753f1939f3"
server_key_iv: "fb0033d3d948f1f8ec47cbbe497f4536"
server_key_version: "encryptionkey@0"
I20260807 02:21:31.861778 1133 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 02:21:31.864526 1153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:31.865806 1133 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 02:21:31.865960 1133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal
uuid: "ef9e75da134d43609cde080ba735a309"
format_stamp: "Formatted at 2026-08-07 02:21:31 on dist-test-slave-39l8"
server_key: "5bd176fdb8ae4f9ad0e51e753f1939f3"
server_key_iv: "fb0033d3d948f1f8ec47cbbe497f4536"
server_key_version: "encryptionkey@0"
I20260807 02:21:31.866083 1133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:31.879743 1133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:31.882922 1133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:31.883147 1133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:31.890686 1133 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.253:42871
I20260807 02:21:31.891050 1237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.253:42871 every 8 connection(s)
I20260807 02:21:31.891798 1133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/data/info.pb
I20260807 02:21:31.892997 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 1133
I20260807 02:21:31.893139 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-1/wal/instance
I20260807 02:21:31.893436 1531 external_mini_cluster.cc:1428] Setting key 71fb5cd7928465b0facf345f153313d9
I20260807 02:21:31.894995 1238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:31.899438 1238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.126.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.126.252@KRBTEST.COM" created.
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:31.914270 1128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.901436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54712 (local address 127.1.126.254:45753)
0807 02:21:31.901611 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:31.901616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:31.902511 (+ 895us) server_negotiation.cc:407] Connection header received
0807 02:21:31.903524 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:31.903527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:31.903585 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:31.903675 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:31.905013 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.905548 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.906820 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.907068 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.907187 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.909886 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:31.909890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:31.909892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:31.909917 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:31.911886 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.912462 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.912468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.912471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.912583 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.912939 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.912944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.912947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.913243 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:31.913365 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:31.913912 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 02:21:31.914069 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 02:21:31.915091 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.901821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45753 (local address 127.0.0.1:54712)
0807 02:21:31.902330 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.902384 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:31.903315 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:31.903851 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:31.903858 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:31.904278 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:31.904856 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.904872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.905685 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.905689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.906667 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.906681 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.907263 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.907269 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.907503 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.908165 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:31.908181 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:31.909685 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:31.912022 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.912028 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.912049 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.912352 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.912686 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.912688 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.912690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.912836 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.913355 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:31.913360 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:31.913624 (+ 264us) client_negotiation.cc:769] Sending connection context
0807 02:21:31.913801 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 02:21:31.914079 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":148,"threads_started":1}
I20260807 02:21:31.915426 1125 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } attempt: 3
I20260807 02:21:31.916930 1238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.126.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab.
Entry for principal kudu/127.1.126.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab.
I20260807 02:21:31.921936 1531 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
/tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:36059
--webserver_interface=127.1.126.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab
--principal=kudu/127.1.126.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.126.212:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.126.254:45753,127.1.126.253:42871,127.1.126.252:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Aug 07 02:21:31 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
I20260807 02:21:31.927253 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.915905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35176)
0807 02:21:31.916030 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.916047 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:31.916121 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:31.917102 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:31.917105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:31.917279 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:31.917428 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.917437 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.918980 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.918983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.920051 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.920062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.921086 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.921093 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.921249 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.921637 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:31.921649 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:31.922878 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:31.925107 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.925111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.925116 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.925391 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.925735 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.925738 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.925741 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.925833 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.926331 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:31.926334 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:31.926441 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 02:21:31.926885 (+ 444us) client_negotiation.cc:240] Negotiation successful
0807 02:21:31.927049 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 02:21:31.927326 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.916022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35176 (local address 127.1.126.253:42871)
0807 02:21:31.916654 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:31.916665 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:31.916684 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:21:31.916750 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:31.916756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:31.916953 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:31.917090 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:31.917753 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.918849 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.920180 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.920744 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.920880 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.923017 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:31.923028 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:31.923046 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:31.923074 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:31.925000 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.925511 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.925517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.925518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.925609 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.925935 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.925940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.925941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.926214 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:31.926368 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:31.926991 (+ 623us) server_negotiation.cc:299] Negotiation successful
0807 02:21:31.927149 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":533,"spinlock_wait_cycles":3328,"thread_start_us":146,"threads_started":1}
I20260807 02:21:31.929575 1125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:31.929725 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.917462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35188)
0807 02:21:31.917560 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.917575 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:31.917648 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:31.918088 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:31.918091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:31.918258 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:31.918367 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.918373 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.919401 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.919408 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.920110 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:31.920127 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.920827 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.920831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:31.920958 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.922821 (+ 1863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:31.922842 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:31.924335 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:31.927735 (+ 3400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.927741 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.927746 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.928006 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.928312 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:31.928317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:31.928322 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:31.928411 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:31.928890 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:31.928894 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:31.928992 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 02:21:31.929104 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 02:21:31.929249 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":22}
I20260807 02:21:31.929738 1246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.917554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35188 (local address 127.1.126.253:42871)
0807 02:21:31.917887 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:31.917893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:31.917905 (+ 12us) server_negotiation.cc:407] Connection header received
0807 02:21:31.917933 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:31.917935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:31.917967 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:31.918039 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:31.918518 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.919295 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.920235 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:31.920713 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:31.920827 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:31.924495 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:31.924501 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:31.924505 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:31.924537 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:31.927582 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.928123 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.928129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.928134 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.928216 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:31.928513 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:31.928517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:31.928521 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:31.928776 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:31.928891 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:31.929191 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 02:21:31.929331 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":276,"thread_start_us":148,"threads_started":1}
I20260807 02:21:31.930821 1238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:31.931051 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.930638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44808)
0807 02:21:31.930887 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.930952 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260807 02:21:31.931660 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.931284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44820)
0807 02:21:31.931537 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.931605 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
W20260807 02:21:31.931931 1158 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
I20260807 02:21:31.932057 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.931676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44824)
0807 02:21:31.931905 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.931962 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260807 02:21:31.932253 1125 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:36059: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
I20260807 02:21:31.933063 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.932845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44832)
0807 02:21:31.932972 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.933015 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 02:21:31.933228 1238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:36059: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
I20260807 02:21:31.963451 1125 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } attempt: 1
I20260807 02:21:31.964481 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.964085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44842)
0807 02:21:31.964293 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.964367 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 02:21:31.965226 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.964990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44858)
0807 02:21:31.965110 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.965163 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 02:21:31.965369 1125 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:36059: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
I20260807 02:21:31.982517 1238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } attempt: 1
I20260807 02:21:31.983484 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.983180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44870)
0807 02:21:31.983332 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.983403 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 02:21:31.984326 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:31.984085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44882)
0807 02:21:31.984221 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:31.984275 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 02:21:31.984504 1238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:36059: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
I20260807 02:21:32.040542 1125 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } attempt: 2
I20260807 02:21:32.041507 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.041128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44898)
0807 02:21:32.041309 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.041391 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 02:21:32.042454 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.042199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44904)
0807 02:21:32.042331 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.042388 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 02:21:32.042613 1125 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:36059: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
W20260807 02:21:32.046590 1247 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 02:21:32.046968 1247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 02:21:32.047029 1247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 02:21:32.047106 1247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 02:21:32.051204 1247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 02:21:32.051286 1247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 02:21:32.051330 1247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 02:21:32.051381 1247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 02:21:32.051419 1247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 02:21:32.052680 1238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } attempt: 2
I20260807 02:21:32.053529 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.053233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44906)
0807 02:21:32.053383 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.053448 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 02:21:32.054291 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.054066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44910)
0807 02:21:32.054186 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.054233 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 02:21:32.054409 1238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.126.252:36059: Network error: Client connection negotiation failed: client connection to 127.1.126.252:36059: connect: Connection refused (error 111)
I20260807 02:21:32.057258 1247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.126.212:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.126.254:45753,127.1.126.253:42871,127.1.126.252:36059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/krb5kdc/kudu_127.1.126.252.keytab
--principal=kudu/127.1.126.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.126.252:36059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.126.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 01:47:39 UTC on ccycloud.quasar-ogxevj.root.comops.site
build id 4571737
I20260807 02:21:32.058403 1247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 02:21:32.059504 1247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 02:21:32.068403 1259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:32.068419 1257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 02:21:32.068406 1255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 02:21:32.068879 1247 server_base.cc:1034] running on GCE node
I20260807 02:21:32.069536 1247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 02:21:32.070649 1247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 02:21:32.071882 1247 hybrid_clock.cc:648] HybridClock initialized: now 1786069292071840 us; error 46 us; skew 500 ppm
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069292, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 02:21:32.075070 1247 init.cc:377] Logged in from keytab as kudu/127.1.126.252@KRBTEST.COM (short username kudu)
I20260807 02:21:32.076063 1247 webserver.cc:460] Webserver started at http://127.1.126.252:37209/ using document root <none> and password file <none>
I20260807 02:21:32.076614 1247 fs_manager.cc:359] Metadata directory not provided
I20260807 02:21:32.076674 1247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 02:21:32.076921 1247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 02:21:32.079252 1247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data/instance:
uuid: "911c68b4e87e4e81b5300943be8bbf2b"
format_stamp: "Formatted at 2026-08-07 02:21:32 on dist-test-slave-39l8"
server_key: "1cf9a10b0659a88f72dd52c31e097743"
server_key_iv: "ff812d0fc15a1e47e2e6b69dcb146dfb"
server_key_version: "encryptionkey@0"
I20260807 02:21:32.079859 1247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal/instance:
uuid: "911c68b4e87e4e81b5300943be8bbf2b"
format_stamp: "Formatted at 2026-08-07 02:21:32 on dist-test-slave-39l8"
server_key: "1cf9a10b0659a88f72dd52c31e097743"
server_key_iv: "ff812d0fc15a1e47e2e6b69dcb146dfb"
server_key_version: "encryptionkey@0"
I20260807 02:21:32.083879 1247 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 02:21:32.086560 1271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 02:21:32.088009 1247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 02:21:32.088192 1247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data,/tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal
uuid: "911c68b4e87e4e81b5300943be8bbf2b"
format_stamp: "Formatted at 2026-08-07 02:21:32 on dist-test-slave-39l8"
server_key: "1cf9a10b0659a88f72dd52c31e097743"
server_key_iv: "ff812d0fc15a1e47e2e6b69dcb146dfb"
server_key_version: "encryptionkey@0"
I20260807 02:21:32.088325 1247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 02:21:32.107738 1247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 02:21:32.111364 1247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 02:21:32.111666 1247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 02:21:32.119316 1247 rpc_server.cc:307] RPC server started. Bound to: 127.1.126.252:36059
I20260807 02:21:32.119727 1344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.126.252:36059 every 8 connection(s)
I20260807 02:21:32.120385 1247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/data/info.pb
I20260807 02:21:32.121404 1531 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu as pid 1247
I20260807 02:21:32.121533 1531 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskd_5Q2x/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786069003535869-1531-0/minicluster-data/master-2/wal/instance
I20260807 02:21:32.121878 1531 external_mini_cluster.cc:1428] Setting key 36d38b212c7382a558f778e934235d69
I20260807 02:21:32.123950 1345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 02:21:32.128517 1345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069292, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
I20260807 02:21:32.137375 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.123312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44912 (local address 127.1.126.252:36059)
0807 02:21:32.123745 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.123761 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.123798 (+ 37us) server_negotiation.cc:407] Connection header received
0807 02:21:32.124520 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.124538 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.124886 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.125186 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.126159 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.127266 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.128445 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.129050 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.129188 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.131973 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.131980 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.131992 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.132040 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.133988 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.134590 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.134595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.134600 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.134778 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.135150 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.135153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.135154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.135566 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.135794 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.136133 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.136429 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":147,"threads_started":1}
I20260807 02:21:32.140564 1128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.130764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.1.126.254:45753)
0807 02:21:32.130918 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.130922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.131323 (+ 401us) server_negotiation.cc:407] Connection header received
0807 02:21:32.131482 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.131486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.131548 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.131595 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.132608 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.133115 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.133992 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.134259 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.134369 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.136768 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.136771 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.136773 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.136796 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.138530 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.139061 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.139066 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.139068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.139156 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.139448 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.139451 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.139452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.139726 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.139824 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.140267 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.140370 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 02:21:32.140599 1350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.130635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.254:45753 (local address 127.0.0.1:54714)
0807 02:21:32.131163 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.131216 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:32.131354 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:32.131776 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:32.131780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:32.132317 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:32.132485 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.132496 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.133251 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.133254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.133860 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.133868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.134383 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.134387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.134515 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.135078 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:32.135096 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:32.136611 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:32.138650 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.138660 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.138666 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.138952 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.139255 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.139259 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.139261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.139355 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.139885 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:32.139891 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:32.140037 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 02:21:32.140192 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 02:21:32.140390 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":251,"threads_started":1}
I20260807 02:21:32.141808 1125 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } attempt: 3
I20260807 02:21:32.141806 1345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:32.145576 1238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } attempt: 3
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.254@KRBTEST.COM
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.254@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069292, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.253@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
I20260807 02:21:32.151832 1129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.142167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44918)
0807 02:21:32.142325 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.142339 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:32.142413 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:32.142687 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:32.142693 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:32.142892 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:32.142993 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.143003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.144070 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.144074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.144750 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.144760 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.145326 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.145329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.145413 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.145900 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:32.145916 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:32.147508 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:32.150020 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.150024 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.150026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.150317 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.150662 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.150667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.150669 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.150800 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.151295 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:32.151299 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:32.151409 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 02:21:32.151500 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 02:21:32.151647 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 02:21:32.152173 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.139885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54716 (local address 127.1.126.254:45753)
0807 02:21:32.140211 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.140226 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.140239 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:21:32.140276 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.140278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.140323 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.140414 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.141173 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.141931 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.143037 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.143292 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.143400 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.146966 (+ 3566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.146973 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.146979 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.147281 (+ 302us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.149823 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.150377 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.150382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.150385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.150485 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.150892 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.150898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.150901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.151169 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.151401 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.151838 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.151965 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":79,"threads_started":1}
I20260807 02:21:32.152943 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.142241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44918 (local address 127.1.126.252:36059)
0807 02:21:32.142353 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.142359 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.142375 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:21:32.142488 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.142491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.142557 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.143104 (+ 547us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.143195 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.143902 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.144881 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.145201 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.145324 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.147861 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.147864 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.147867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.147892 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.149894 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.150464 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.150467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.150469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.150546 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.150933 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.150936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.150938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.151164 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.152552 (+ 1388us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.152627 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.152751 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":41}
I20260807 02:21:32.154141 1246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.142667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35192 (local address 127.1.126.253:42871)
0807 02:21:32.142816 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.142820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.142835 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:21:32.142882 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.142885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.142933 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.143015 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.143542 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.144299 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.146019 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.146402 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.146488 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.149701 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.149706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.149709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.149739 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.152070 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.152553 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.152560 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.152563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.152658 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.153000 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.153006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.153008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.153333 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.153412 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.153830 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.153982 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 02:21:32.155454 1350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.142372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.253:42871 (local address 127.0.0.1:35192)
0807 02:21:32.142615 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.142627 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:32.142695 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:32.143174 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:32.143178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:32.143343 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:32.143434 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.143440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.144426 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.144429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.145869 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.145881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.146669 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.146676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.146822 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.147662 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:32.147673 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:32.149528 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:32.152166 (+ 2638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.152173 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.152175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.152420 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.152760 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.152762 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.152763 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.152884 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.153490 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:32.153493 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:32.153604 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 02:21:32.155140 (+ 1536us) client_negotiation.cc:240] Negotiation successful
0807 02:21:32.155285 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181}
I20260807 02:21:32.156424 1345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } has no permanent_uuid. Determining permanent_uuid...
I20260807 02:21:32.156687 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.145986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44926)
0807 02:21:32.146105 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.146118 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:32.146185 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:32.146858 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:32.146862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:32.147039 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:32.147138 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.147145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.148235 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.148239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.148925 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.148939 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.149609 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.149615 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.149737 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.150234 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:32.150252 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:32.151742 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:32.154768 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.154772 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.154774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.155004 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.155595 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.155602 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.155605 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.155721 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.156196 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:32.156199 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:32.156300 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 02:21:32.156380 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 02:21:32.156507 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 02:21:32.157193 1125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3: Bootstrap starting.
I20260807 02:21:32.158160 1352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.146227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44926 (local address 127.1.126.252:36059)
0807 02:21:32.146551 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.146562 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.146577 (+ 15us) server_negotiation.cc:407] Connection header received
0807 02:21:32.146619 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.146621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.146665 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.147258 (+ 593us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.147348 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.148055 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.149056 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.149460 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.149965 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.152352 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.152355 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.152358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.152382 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.154610 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.155344 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.155348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.155352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.155465 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.155851 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.155857 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.155860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.156067 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.157741 (+ 1674us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.157821 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.157940 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":99,"threads_started":1}
I20260807 02:21:32.160442 1125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3: Neither blocks nor log segments found. Creating new log.
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.126.253@KRBTEST.COM
I20260807 02:21:32.161595 1125 log.cc:824] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3: Log is configured to *not* fsync() on all Append() calls
Aug 07 02:21:32 dist-test-slave-39l8 krb5kdc[1008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786069292, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.126.252@KRBTEST.COM for kudu/127.1.126.252@KRBTEST.COM
I20260807 02:21:32.162410 1238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: Bootstrap starting.
I20260807 02:21:32.164275 1125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3: No bootstrap required, opened a new log
I20260807 02:21:32.165473 1238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:32.166272 1350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.156984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.126.252:36059 (local address 127.0.0.1:44940)
0807 02:21:32.157128 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 02:21:32.157143 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 02:21:32.157221 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 02:21:32.157710 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 02:21:32.157713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 02:21:32.157883 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 02:21:32.157966 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.157972 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.159070 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.159073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.159876 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 02:21:32.159890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.160638 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.160644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 02:21:32.160772 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.161221 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 02:21:32.161236 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 02:21:32.162685 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 02:21:32.164553 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.164556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.164559 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.164810 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.165124 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 02:21:32.165127 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 02:21:32.165129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 02:21:32.165226 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 02:21:32.165660 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 02:21:32.165663 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 02:21:32.165782 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 02:21:32.165898 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 02:21:32.166051 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 02:21:32.166433 1238 log.cc:824] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:32.166309 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.157332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44940 (local address 127.1.126.252:36059)
0807 02:21:32.157453 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.157457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.157470 (+ 13us) server_negotiation.cc:407] Connection header received
0807 02:21:32.157501 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.157503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.157543 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.157614 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.158078 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.158759 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.160022 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.160439 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.160531 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.162861 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.162864 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.162866 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.162888 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.164436 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.164923 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.164927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.164928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.165016 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.165332 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.165336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.165338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.165559 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.165659 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.165968 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.166123 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":51}
I20260807 02:21:32.168752 1125 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.168990 1125 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2b6e9ab3238444a9597163050205ce3, State: Initialized, Role: FOLLOWER
I20260807 02:21:32.169435 1125 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.170125 1358 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.170315 1358 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:32.170456 1345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: Bootstrap starting.
I20260807 02:21:32.170881 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.154073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.1.126.253:42871)
0807 02:21:32.154213 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.154218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.155018 (+ 800us) server_negotiation.cc:407] Connection header received
0807 02:21:32.155117 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.155120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.155170 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.155255 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.156205 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.156930 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.158079 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.158458 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.158543 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.162239 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.162244 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.162247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.162276 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.168493 (+ 6217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.169117 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.169122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.169124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.169232 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.169595 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.169602 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.169603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.169872 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.170072 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.170494 (+ 422us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.170631 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 02:21:32.171573 1125 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:32.174531 1345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: Neither blocks nor log segments found. Creating new log.
I20260807 02:21:32.175134 1531 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 02:21:32.175951 1345 log.cc:824] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: Log is configured to *not* fsync() on all Append() calls
I20260807 02:21:32.176497 1090 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c2b6e9ab3238444a9597163050205ce3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54716
I20260807 02:21:32.176761 1090 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 02:21:32.176887 1090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 0 FOLLOWER]: Advancing to term 1
W20260807 02:21:32.177627 1375 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:32.177699 1375 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:32.178275 1090 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.179337 1090 leader_election.cc:288] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [CANDIDATE]: Term 1 election: Requested vote from peers ef9e75da134d43609cde080ba735a309 (127.1.126.253:42871), 911c68b4e87e4e81b5300943be8bbf2b (127.1.126.252:36059)
I20260807 02:21:32.179893 1238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: No bootstrap required, opened a new log
I20260807 02:21:32.176935 1030 master_runner.cc:186] Error getting master registration for 127.1.126.253:42871: OK, instance_id { permanent_uuid: "ef9e75da134d43609cde080ba735a309" instance_seqno: 1786069291888655 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 02:21:32.180312 1030 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 02:21:32.183550 1345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: No bootstrap required, opened a new log
I20260807 02:21:32.185009 1238 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.185290 1238 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9e75da134d43609cde080ba735a309, State: Initialized, Role: FOLLOWER
I20260807 02:21:32.185655 1238 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.186348 1383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.186682 1383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:32.187186 1238 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 02:21:32.187271 1199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2b6e9ab3238444a9597163050205ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ef9e75da134d43609cde080ba735a309"
I20260807 02:21:32.187515 1199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:32.188057 1345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.188305 1345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911c68b4e87e4e81b5300943be8bbf2b, State: Initialized, Role: FOLLOWER
I20260807 02:21:32.188632 1345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.188994 1199 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2b6e9ab3238444a9597163050205ce3 in term 1.
I20260807 02:21:32.189738 1055 leader_election.cc:302] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2b6e9ab3238444a9597163050205ce3, ef9e75da134d43609cde080ba735a309; no voters:
I20260807 02:21:32.190073 1358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 02:21:32.190340 1358 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [term 1 LEADER]: Becoming Leader. State: Replica: c2b6e9ab3238444a9597163050205ce3, State: Running, Role: LEADER
I20260807 02:21:32.190752 1358 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } }
I20260807 02:21:32.192000 1345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: configured and running, proceeding with master startup.
W20260807 02:21:32.192793 1400 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:32.192871 1400 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:32.192803 1358 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2b6e9ab3238444a9597163050205ce3. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.192950 1358 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:32.193353 1310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c2b6e9ab3238444a9597163050205ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "911c68b4e87e4e81b5300943be8bbf2b"
I20260807 02:21:32.193600 1310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [term 0 FOLLOWER]: Advancing to term 1
I20260807 02:21:32.195181 1310 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2b6e9ab3238444a9597163050205ce3 in term 1.
I20260807 02:21:32.196918 1411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 02:21:32.198123 1411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 02:21:32.202215 1395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.202385 1395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: This master's current role is: FOLLOWER
W20260807 02:21:32.207674 1420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 02:21:32.207787 1420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 02:21:32.215380 1310 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [term 1 FOLLOWER]: Refusing update from remote peer c2b6e9ab3238444a9597163050205ce3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:21:32.216209 1358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:21:32.220867 1395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2b6e9ab3238444a9597163050205ce3. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.221026 1395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:32.222222 1199 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [term 1 FOLLOWER]: Refusing update from remote peer c2b6e9ab3238444a9597163050205ce3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 02:21:32.222910 1358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 02:21:32.227375 1383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2b6e9ab3238444a9597163050205ce3. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.227523 1383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:32.229012 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.203248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.1.126.253:42871)
0807 02:21:32.203370 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.203375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.215059 (+ 11684us) server_negotiation.cc:407] Connection header received
0807 02:21:32.215297 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.215302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.215359 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.215413 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.216609 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.217435 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.218970 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.219334 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.219416 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.224393 (+ 4977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.224398 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.224402 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.224436 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.226647 (+ 2211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.227209 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.227213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.227215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.227307 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.227609 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.227613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.227615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.227841 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.227959 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.228693 (+ 734us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.228835 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:21:32.234978 1402 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.235158 1402 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:32.236666 1383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.236812 1383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:32.237291 1421 mvcc.cc:205] Tried to move back new op lower bound from 7315739820904251392 to 7315739820817272832. Current Snapshot: MvccSnapshot[applied={T|T < 7315739820904251392}]
I20260807 02:21:32.238765 1358 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.238899 1358 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3 [sys.catalog]: This master's current role is: LEADER
I20260807 02:21:32.240010 1395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c2b6e9ab3238444a9597163050205ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2b6e9ab3238444a9597163050205ce3" member_type: VOTER last_known_addr { host: "127.1.126.254" port: 45753 } } peers { permanent_uuid: "ef9e75da134d43609cde080ba735a309" member_type: VOTER last_known_addr { host: "127.1.126.253" port: 42871 } } peers { permanent_uuid: "911c68b4e87e4e81b5300943be8bbf2b" member_type: VOTER last_known_addr { host: "127.1.126.252" port: 36059 } } }
I20260807 02:21:32.240160 1395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 02:21:32.240993 1429 mvcc.cc:205] Tried to move back new op lower bound from 7315739820904251392 to 7315739820817272832. Current Snapshot: MvccSnapshot[applied={T|T < 7315739820904251392}]
I20260807 02:21:32.242378 1427 mvcc.cc:205] Tried to move back new op lower bound from 7315739820904251392 to 7315739820817272832. Current Snapshot: MvccSnapshot[applied={T|T < 7315739820904251392}]
I20260807 02:21:32.246520 1411 catalog_manager.cc:1347] Generated new cluster ID: 0557c95559014487ae868262a97628f3
I20260807 02:21:32.246624 1411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 02:21:32.247339 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.203794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.1.126.254:45753)
0807 02:21:32.203914 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.203918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.218886 (+ 14968us) server_negotiation.cc:407] Connection header received
0807 02:21:32.220131 (+ 1245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.220135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.220203 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.220256 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.222338 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.223189 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.224808 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.225198 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.225279 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.233320 (+ 8041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.233324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.233327 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.233360 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.235229 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.237751 (+ 2522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.237755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.237758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.237863 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.238191 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.238195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.238197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.238427 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.238543 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.246968 (+ 8425us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.247158 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 02:21:32.254382 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:32.204494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44942 (local address 127.1.126.252:36059)
0807 02:21:32.204640 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.204644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.232140 (+ 27496us) server_negotiation.cc:407] Connection header received
0807 02:21:32.232343 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.232347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.232401 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.232455 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.235765 (+ 3310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.236579 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.247955 (+ 11376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:32.248345 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:32.248440 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:32.250392 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 02:21:32.250396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 02:21:32.250400 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 02:21:32.250431 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 02:21:32.252261 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.252825 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.252829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.252831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.252916 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 02:21:32.253340 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 02:21:32.253344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 02:21:32.253346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 02:21:32.253580 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 02:21:32.253693 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:32.254060 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 02:21:32.254206 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 02:21:32.272666 1411 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 02:21:32.275406 1411 catalog_manager.cc:1504] Loading token signing keys...
I20260807 02:21:32.292817 1411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2b6e9ab3238444a9597163050205ce3: Generated new TSK 0
I20260807 02:21:32.293922 1411 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 02:21:32.329267 1351 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.325922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54730 (local address 127.1.126.254:45753)
0807 02:21:32.326058 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.326062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.328045 (+ 1983us) server_negotiation.cc:407] Connection header received
0807 02:21:32.328314 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.328319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.328371 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.328425 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.329120 (+ 695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54730: BlockingRecv error: recv got EOF from 127.0.0.1:54730 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 02:21:32.331269 1349 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.326739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44958 (local address 127.1.126.252:36059)
0807 02:21:32.326861 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.326865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.329850 (+ 2985us) server_negotiation.cc:407] Connection header received
0807 02:21:32.330213 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.330217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.330274 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.330328 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.331133 (+ 805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44958: BlockingRecv error: recv got EOF from 127.0.0.1:44958 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 02:21:32.332603 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.327435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35226 (local address 127.1.126.253:42871)
0807 02:21:32.327549 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.327553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.330578 (+ 3025us) server_negotiation.cc:407] Connection header received
0807 02:21:32.331825 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.331829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.331886 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.331939 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.332484 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35226: BlockingRecv error: recv got EOF from 127.0.0.1:35226 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 02:21:32.337622 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.335835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.1.126.253:42871)
0807 02:21:32.335939 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.335943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.336433 (+ 490us) server_negotiation.cc:407] Connection header received
0807 02:21:32.336800 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.336804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.336884 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.336961 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.337481 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35232: BlockingRecv error: recv got EOF from 127.0.0.1:35232 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 02:21:32.342971 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.341424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35242 (local address 127.1.126.253:42871)
0807 02:21:32.341525 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.341530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.342043 (+ 513us) server_negotiation.cc:407] Connection header received
0807 02:21:32.342221 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.342225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.342274 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.342324 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.342871 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35242: BlockingRecv error: recv got EOF from 127.0.0.1:35242 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 02:21:32.349393 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.347592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35244 (local address 127.1.126.253:42871)
0807 02:21:32.347730 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.347735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.348328 (+ 593us) server_negotiation.cc:407] Connection header received
0807 02:21:32.348557 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.348561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.348631 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.348689 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.349274 (+ 585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35244: BlockingRecv error: recv got EOF from 127.0.0.1:35244 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260807 02:21:32.357846 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.356055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35248 (local address 127.1.126.253:42871)
0807 02:21:32.356213 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.356218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.356799 (+ 581us) server_negotiation.cc:407] Connection header received
0807 02:21:32.357017 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.357021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.357082 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.357136 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.357722 (+ 586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35248: BlockingRecv error: recv got EOF from 127.0.0.1:35248 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 02:21:32.371053 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.368751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35258 (local address 127.1.126.253:42871)
0807 02:21:32.368894 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.368899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.369684 (+ 785us) server_negotiation.cc:407] Connection header received
0807 02:21:32.370004 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.370008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.370072 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.370136 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.370907 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35258: BlockingRecv error: recv got EOF from 127.0.0.1:35258 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 02:21:32.392089 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.390031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35274 (local address 127.1.126.253:42871)
0807 02:21:32.390164 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.390169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.390844 (+ 675us) server_negotiation.cc:407] Connection header received
0807 02:21:32.391064 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.391068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.391126 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.391181 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.391898 (+ 717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35274: BlockingRecv error: recv got EOF from 127.0.0.1:35274 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 02:21:32.428464 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.426953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35280 (local address 127.1.126.253:42871)
0807 02:21:32.427126 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.427131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.427307 (+ 176us) server_negotiation.cc:407] Connection header received
0807 02:21:32.427494 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.427503 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.427571 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.427664 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.428276 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35280: BlockingRecv error: recv got EOF from 127.0.0.1:35280 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 02:21:32.496049 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.494773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35296 (local address 127.1.126.253:42871)
0807 02:21:32.494950 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.494955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.495089 (+ 134us) server_negotiation.cc:407] Connection header received
0807 02:21:32.495280 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.495284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.495343 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.495438 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.495933 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35296: BlockingRecv error: recv got EOF from 127.0.0.1:35296 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 02:21:32.627826 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.626439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35302 (local address 127.1.126.253:42871)
0807 02:21:32.626633 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.626638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.626845 (+ 207us) server_negotiation.cc:407] Connection header received
0807 02:21:32.627032 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.627038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.627094 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.627200 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.627703 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35302: BlockingRecv error: recv got EOF from 127.0.0.1:35302 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 02:21:32.887652 1245 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 02:21:32.886333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35318 (local address 127.1.126.253:42871)
0807 02:21:32.886486 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:32.886492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:32.886582 (+ 90us) server_negotiation.cc:407] Connection header received
0807 02:21:32.886806 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:32.886814 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:32.886867 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:32.886964 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 02:21:32.887477 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35318: BlockingRecv error: recv got EOF from 127.0.0.1:35318 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 02:21:33.194430 1400 catalog_manager.cc:1259] Loaded cluster ID: 0557c95559014487ae868262a97628f3
I20260807 02:21:33.194519 1400 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: loading cluster ID for follower catalog manager: success
I20260807 02:21:33.196226 1400 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: acquiring CA information for follower catalog manager: success
I20260807 02:21:33.197449 1400 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ef9e75da134d43609cde080ba735a309: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 02:21:33.209384 1420 catalog_manager.cc:1259] Loaded cluster ID: 0557c95559014487ae868262a97628f3
I20260807 02:21:33.209462 1420 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: loading cluster ID for follower catalog manager: success
I20260807 02:21:33.211292 1420 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: acquiring CA information for follower catalog manager: success
I20260807 02:21:33.212502 1420 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 911c68b4e87e4e81b5300943be8bbf2b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 02:21:33.406101 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:33.402019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35322 (local address 127.1.126.253:42871)
0807 02:21:33.402294 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:33.402298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:33.402314 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:21:33.402440 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:33.402443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:33.402578 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:33.402681 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:33.403034 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.403592 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.404562 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.404786 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.404871 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:33.405204 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:33.405655 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:33.405755 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:33.405840 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 02:21:33.405894 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":77,"threads_started":1}
I20260807 02:21:33.413975 1549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:33.409708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44966 (local address 127.1.126.252:36059)
0807 02:21:33.409977 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:33.409983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:33.409999 (+ 16us) server_negotiation.cc:407] Connection header received
0807 02:21:33.410209 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:33.410212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:33.410346 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:33.410491 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:33.410780 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.411370 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.412307 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.412560 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.412690 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:33.413030 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:33.413504 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:33.413659 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:33.413732 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 02:21:33.413796 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":67,"threads_started":1}
I20260807 02:21:33.422088 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:33.417299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35336 (local address 127.1.126.253:42871)
0807 02:21:33.417450 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:33.417456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:33.417890 (+ 434us) server_negotiation.cc:407] Connection header received
0807 02:21:33.418091 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:33.418095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:33.418181 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:33.418266 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:33.418760 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.419495 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.420931 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.421207 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.421321 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:33.421580 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:33.421665 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:33.421746 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:33.421865 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 02:21:33.421922 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 02:21:33.422394 1549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:33.417723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.1.126.252:36059)
0807 02:21:33.417845 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:33.417850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:33.417921 (+ 71us) server_negotiation.cc:407] Connection header received
0807 02:21:33.418399 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:33.418401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:33.418444 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:33.418539 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:33.418866 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.419626 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.420989 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.421392 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.421501 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:33.421876 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:33.421954 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:33.422000 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:33.422176 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 02:21:33.422236 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 02:21:33.423663 1558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 02:21:33.417206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54742 (local address 127.1.126.254:45753)
0807 02:21:33.417628 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 02:21:33.417635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 02:21:33.417654 (+ 19us) server_negotiation.cc:407] Connection header received
0807 02:21:33.417875 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 02:21:33.417879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 02:21:33.418074 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 02:21:33.418217 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 02:21:33.418724 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.419621 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.421816 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 02:21:33.422228 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 02:21:33.422333 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 02:21:33.422853 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 02:21:33.423248 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 02:21:33.423350 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 02:21:33.423438 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 02:21:33.423505 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":85,"threads_started":1}
I20260807 02:21:33.427404 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 1030
I20260807 02:21:33.441824 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 1133
I20260807 02:21:33.453421 1531 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskd_5Q2x/build/debug/bin/kudu with pid 1247
2026-08-07T02:21:33Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3346 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6744 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (289897 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST